-- Logs begin at Wed 2022-05-25 11:17:58 UTC, end at Wed 2022-05-25 12:18:27 UTC. -- May 25 11:51:02.907688 dv-osbrick-830800-15-ceph systemd[1]: Starting Devstack devstack@keystone.service... May 25 11:51:02.917667 dv-osbrick-830800-15-ceph devstack@keystone.service[86933]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 25 11:51:02.918823 dv-osbrick-830800-15-ceph devstack@keystone.service[86933]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 25 11:51:02 2022] *** May 25 11:51:02.918823 dv-osbrick-830800-15-ceph devstack@keystone.service[86933]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 25 11:51:02.918823 dv-osbrick-830800-15-ceph devstack@keystone.service[86933]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 25 11:51:02.918823 dv-osbrick-830800-15-ceph devstack@keystone.service[86933]: nodename: dv-osbrick-830800-15-ceph May 25 11:51:02.918823 dv-osbrick-830800-15-ceph devstack@keystone.service[86933]: machine: x86_64 May 25 11:51:02.918823 dv-osbrick-830800-15-ceph devstack@keystone.service[86933]: clock source: unix May 25 11:51:02.918823 dv-osbrick-830800-15-ceph devstack@keystone.service[86933]: pcre jit disabled May 25 11:51:02.918823 dv-osbrick-830800-15-ceph devstack@keystone.service[86933]: detected number of CPU cores: 4 May 25 11:51:02.918823 dv-osbrick-830800-15-ceph devstack@keystone.service[86933]: current working directory: / May 25 11:51:02.918823 dv-osbrick-830800-15-ceph devstack@keystone.service[86933]: detected binary path: /usr/bin/uwsgi-core May 25 11:51:02.918823 dv-osbrick-830800-15-ceph devstack@keystone.service[86933]: your processes number limit is 47680 May 25 11:51:02.918823 dv-osbrick-830800-15-ceph devstack@keystone.service[86933]: your memory page size is 4096 bytes May 25 11:51:02.918823 dv-osbrick-830800-15-ceph devstack@keystone.service[86933]: detected max file descriptor number: 2048 May 25 11:51:02.918823 dv-osbrick-830800-15-ceph devstack@keystone.service[86933]: lock engine: pthread robust mutexes May 25 11:51:02.918823 dv-osbrick-830800-15-ceph devstack@keystone.service[86933]: thunder lock: enabled May 25 11:51:02.918823 dv-osbrick-830800-15-ceph devstack@keystone.service[86933]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 25 11:51:02.918823 dv-osbrick-830800-15-ceph devstack@keystone.service[86933]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 25 11:51:02.967929 dv-osbrick-830800-15-ceph devstack@keystone.service[86933]: Python main interpreter initialized at 0x55c1394369c0 May 25 11:51:02.967929 dv-osbrick-830800-15-ceph devstack@keystone.service[86933]: python threads support enabled May 25 11:51:02.967929 dv-osbrick-830800-15-ceph devstack@keystone.service[86933]: your server socket listen backlog is limited to 100 connections May 25 11:51:02.967929 dv-osbrick-830800-15-ceph devstack@keystone.service[86933]: your mercy for graceful operations on workers is 90 seconds May 25 11:51:02.968255 dv-osbrick-830800-15-ceph devstack@keystone.service[86933]: mapped 403077 bytes (393 KB) for 2 cores May 25 11:51:02.968330 dv-osbrick-830800-15-ceph devstack@keystone.service[86933]: *** Operational MODE: preforking *** May 25 11:51:02.968592 dv-osbrick-830800-15-ceph devstack@keystone.service[86933]: *** uWSGI is running in multiple interpreter mode *** May 25 11:51:02.968592 dv-osbrick-830800-15-ceph devstack@keystone.service[86933]: spawned uWSGI master process (pid: 86933) May 25 11:51:02.968778 dv-osbrick-830800-15-ceph systemd[1]: Started Devstack devstack@keystone.service. May 25 11:51:02.969869 dv-osbrick-830800-15-ceph devstack@keystone.service[86933]: spawned uWSGI worker 1 (pid: 86938, cores: 1) May 25 11:51:02.969869 dv-osbrick-830800-15-ceph devstack@keystone.service[86933]: spawned uWSGI worker 2 (pid: 86939, cores: 1) May 25 11:51:02.969869 dv-osbrick-830800-15-ceph devstack@keystone.service[86933]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 25 11:51:08.720899 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 11:51:08.720899 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: from cryptography.utils import int_from_bytes May 25 11:51:08.721678 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 11:51:08.721678 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: from cryptography.utils import int_from_bytes May 25 11:51:08.722181 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 11:51:08.722181 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: from cryptography.utils import int_from_bytes May 25 11:51:08.722629 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 11:51:08.722629 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: from cryptography.utils import int_from_bytes May 25 11:51:08.770814 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 11:51:08.770975 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 11:51:08.771060 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 11:51:08.771171 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 11:51:08.771252 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] command line args: [] {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 11:51:08.771363 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] command line args: [] {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 11:51:08.771448 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 11:51:08.771609 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] ================================================================================ {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 11:51:08.771693 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 11:51:08.771810 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] ================================================================================ {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 11:51:08.771900 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] admin_token = **** {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.772082 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] admin_token = **** {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.772168 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] config_dir = [] {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.772306 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.772390 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] config_dir = [] {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.772489 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] config_source = [] {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.772572 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.772655 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] debug = True {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.772732 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] config_source = [] {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.772840 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] debug = True {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.772922 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.773166 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.773298 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.773402 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.773511 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.773607 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.773710 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.773806 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.773905 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.774013 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.774115 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] list_limit = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.774464 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] list_limit = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.774567 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] log_config_append = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.774668 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] log_config_append = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.774775 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.774876 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.774971 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] log_dir = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.775066 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] log_dir = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.775176 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] log_file = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.775278 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] log_file = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.775384 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.775469 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.775585 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.775666 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.775811 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.775898 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.775972 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.776099 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.776181 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.776309 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.776386 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.776509 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.776591 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.776667 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.776783 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.776866 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.776968 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.777047 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.777239 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.777328 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.777532 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.777621 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.777771 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.777907 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.778026 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.778152 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.778272 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.778392 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.778505 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.778618 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.779020 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.44/identity {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.779196 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.44/identity {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.779196 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] publish_errors = False {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.779492 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] publish_errors = False {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.779649 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.779785 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.780014 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.780162 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.780307 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.780423 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.780571 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.780747 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.780872 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.781019 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.781137 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] standard_threads = False {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.781250 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] standard_threads = False {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.781372 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.781485 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.781626 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.781741 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.781859 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.781982 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.782096 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] use_journal = False {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.782208 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] use_journal = False {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.782319 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] use_json = False {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.782432 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] use_json = False {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.782543 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] use_stderr = False {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.782661 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] use_stderr = False {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.782775 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] use_syslog = False {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.782886 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] use_syslog = False {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.783027 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.783149 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 11:51:08.783262 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.783385 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.783506 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.783619 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.783736 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.783864 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.783977 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.784104 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.784218 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.784330 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.784441 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.784554 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.784665 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.784853 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.784975 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.785088 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.785199 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.785311 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.785422 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.785546 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.785685 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.785800 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.785917 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.786036 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.786148 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.786275 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.786390 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.786506 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.786625 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.786738 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.786849 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.786973 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.787087 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.787199 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.787311 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.787423 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.787534 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.787656 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.787770 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.787903 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.788015 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.788127 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.788238 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.788364 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.788478 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.788595 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.788708 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.788831 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.788949 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.789070 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.789183 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.789300 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.789412 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.789529 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.789652 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.789765 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.789876 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.789992 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.790104 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.790215 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.790398 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.790514 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.790625 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.790736 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.790879 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.791021 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.791142 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.791255 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.791367 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.791478 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.791590 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.791701 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.791842 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.791965 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.792084 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.792197 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.792308 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.792426 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.792546 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.792659 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.792772 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.792885 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.793002 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.793120 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.793241 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.793360 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.793478 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.793591 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.793703 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.793815 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.793935 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.794049 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.794161 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.794273 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.794886 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.795000 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.795120 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.795233 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.795352 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.795464 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.795580 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.795692 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.795868 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.795986 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.796133 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.796256 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.796376 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.796489 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.796613 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.796734 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.796854 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.796968 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.797081 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.797193 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.797314 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.797428 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.797547 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.797667 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.797780 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.797901 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.798015 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.798140 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.798255 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.798376 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.798491 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.798612 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.798735 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.798853 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.798975 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.799091 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.799212 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.799326 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.799450 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.799651 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.799779 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.799910 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.800024 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.800136 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.800250 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.800374 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.800490 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.800603 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.800716 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.800828 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.800940 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.801061 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.801176 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.801289 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.801402 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.801515 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.801628 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.801752 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.801866 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.801979 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.802098 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.802211 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.802325 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.802513 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.802629 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.802742 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.802855 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.802968 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.803088 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.803210 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.803324 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.803437 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.803550 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.803663 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.803775 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.803999 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.804115 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.804228 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.804347 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.804471 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.804586 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.804711 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.804826 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.804939 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.805052 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.805164 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.805277 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.805398 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.805522 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.805649 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.805764 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.805877 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.805990 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.806103 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.806215 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.806337 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.806451 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.806565 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.806678 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.806791 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.806931 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.807054 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.807169 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.807282 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.807431 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.807558 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.807673 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.807810 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.807927 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.808051 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.808165 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.808278 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.808399 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.808514 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.808628 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] auth.external = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.808741 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] auth.external = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.808857 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.808973 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.809095 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.809245 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.809375 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.809490 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.809595 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] auth.password = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.809692 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] auth.password = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.809788 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] auth.token = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.810077 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] auth.token = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.810707 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.810829 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.810944 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.811058 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.811177 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.811292 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.811414 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.811529 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.811644 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.811758 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.811908 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.812022 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.812153 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.812268 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.812390 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] credential.caching = True {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.812505 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] credential.caching = True {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.812619 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.812738 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.812738 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.812964 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.813077 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.813191 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.813304 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.813423 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.813545 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.813660 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.813770 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.813867 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.813979 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.814092 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.814217 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.814332 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.814445 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.814558 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.814671 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.814790 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.814913 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.815029 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.815150 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.815265 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.815377 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.815490 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.815611 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.815725 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.815852 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.815968 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.816082 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] federation.caching = True {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.816205 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] federation.caching = True {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.816328 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.816443 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.816558 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.816671 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.816785 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.816898 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.817089 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.817206 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.817327 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.817450 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.817564 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.817678 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.817800 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.817915 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.818030 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.818150 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.818265 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.818378 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.818500 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.818615 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.818729 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.818843 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.818960 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] identity.caching = True {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.819075 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] identity.caching = True {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.819197 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.819313 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.819426 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.819540 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.819654 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.819779 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.819926 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.820041 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.820155 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.820269 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.820383 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.820509 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.820624 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.820738 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.820857 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.820977 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.821091 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.821214 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.821329 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.821449 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.821564 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.821678 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.821791 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.821913 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.822028 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.822132 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.822245 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.822359 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.822472 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.822596 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.822711 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.822825 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.822938 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.823051 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.823164 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.823286 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.823401 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.823514 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.823627 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.823739 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.823900 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.824027 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.824143 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.824256 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.824370 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.824483 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.824596 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.824717 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.824832 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.824946 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.825059 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.825171 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.825284 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.825407 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.825540 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.825659 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.825772 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.825885 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.825998 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.826120 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.826235 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.826349 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.826463 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.826577 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.826690 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.826812 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.826927 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.827041 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.827163 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.827326 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.827446 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.827570 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.827686 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.827816 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.827932 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.828078 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.828195 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.828320 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.828436 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.828551 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.828664 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.828777 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.828890 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.829015 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.829131 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.829245 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.829358 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.829471 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.829585 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.829708 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.829823 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.829937 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.830050 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.830164 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.830277 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.830399 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.830514 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.830629 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.830743 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.830857 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.830970 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] ldap.user = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.831092 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] ldap.user = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.831208 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.831322 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.831435 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.831548 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.831669 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.831784 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.831919 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.832033 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.832156 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.832271 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.832392 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.832507 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.832621 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.832735 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.832848 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.832969 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.833076 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.833174 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.833271 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.833367 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.833463 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.833560 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.833687 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.833788 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.833890 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.833992 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.834089 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.834186 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.834291 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.834397 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.834494 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.834595 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.834710 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.834825 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.834946 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.835062 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.835175 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.835287 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.835400 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.835505 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.835609 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.835722 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.835850 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.835966 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.836070 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.836166 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.836275 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.836375 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.836472 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.836586 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.836684 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.836796 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.836902 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.837017 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.837131 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.837244 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.837342 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.837342 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.837561 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.837677 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.837790 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.837903 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.838018 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.838121 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.838228 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.838326 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.838422 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.838525 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.838622 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.838718 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.838888 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.839000 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] resource.caching = True {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.839000 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.839185 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.839283 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.839379 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] resource.caching = True {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.839484 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.839582 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.839678 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.839678 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.839923 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.840022 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.840131 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.840231 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.840334 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.840430 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.840525 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.840621 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.840731 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.840829 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] role.caching = True {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.840925 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.841020 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] role.driver = sql {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.841117 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.841248 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.841354 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.841453 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.841549 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] role.caching = True {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.841652 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.841750 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] role.driver = sql {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.841844 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.841932 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.842008 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.842079 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.842151 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.842223 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.842302 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.842375 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.842447 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.842518 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.842626 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.842707 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.842788 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.842868 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.842941 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.843012 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.843083 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.843154 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.843233 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.843354 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.843469 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.843582 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.843582 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.843809 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.843938 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.844061 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.844176 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.844290 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.844290 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.844504 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.844627 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.844742 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.844857 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.844971 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.845084 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.845263 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.845392 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.845508 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.845623 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.845737 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.845852 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.845996 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.846122 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.846238 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.846354 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.846468 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.846582 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.846696 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.846819 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.846940 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.847055 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.847169 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.847274 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.847395 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.847511 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.847626 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.847740 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.847868 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.847982 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.848108 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.848224 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] token.caching = True {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.848338 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.848453 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.848567 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.848681 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.848802 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.848921 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.849036 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] token.caching = True {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.849150 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.849264 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.849377 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.849501 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.849616 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.849731 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.849844 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.849958 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.850071 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.850192 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.850308 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.850422 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.850536 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.850649 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.850762 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.850884 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.851000 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.851113 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.851228 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.851341 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.851454 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.851585 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.851702 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.851864 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.851983 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.852097 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.852211 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.852336 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.852452 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] database.connection = **** {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.852574 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.852683 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.852782 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.852895 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.853008 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.853122 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.853244 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] database.connection = **** {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.853368 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.853491 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.853606 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.853721 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.853834 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.853948 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.854070 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.854185 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.854298 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.854412 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.854525 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.854639 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.854761 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.854877 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.854990 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.855104 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.855217 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.855331 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.855452 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.855568 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.855681 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.855810 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.855926 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.856040 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.856230 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.856348 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.856463 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.856577 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.856692 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.857315 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.857448 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86938) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 11:51:08.857565 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.857565 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.857565 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 11:51:08.857565 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 11:51:08.887860 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 11:51:08.888118 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 11:51:08.888202 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 11:51:08.888349 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 11:51:08.888435 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 11:51:08.888583 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 11:51:08.897079 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 11:51:08.897167 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 11:51:08.925543 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 11:51:08.925732 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 11:51:08.925817 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 11:51:08.925967 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 11:51:08.978166 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 11:51:08.978281 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 11:51:09.029205 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 11:51:09.029442 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 11:51:09.029546 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 11:51:09.029689 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 11:51:09.095819 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 11:51:09.096059 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 11:51:09.096285 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 11:51:09.096465 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 11:51:09.096554 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 11:51:09.096698 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 11:51:09.096780 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 11:51:09.096909 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 11:51:09.096992 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 11:51:09.097127 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 11:51:09.097343 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 11:51:09.097559 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 11:51:09.122271 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 11:51:09.122389 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 11:51:09.122568 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 11:51:09.122652 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 11:51:09.122756 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 11:51:09.122840 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 11:51:09.122982 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 11:51:09.123074 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 11:51:09.123204 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 11:51:09.123287 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 11:51:09.123422 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 11:51:09.123504 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 11:51:09.123634 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 11:51:09.123724 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 11:51:09.134901 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 11:51:09.135028 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 11:51:09.147492 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 11:51:09.147728 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 11:51:09.147848 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 11:51:09.147977 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 11:51:09.148058 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 11:51:09.148192 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 11:51:09.148276 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 11:51:09.148413 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 11:51:09.148496 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 11:51:09.148623 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 11:51:09.148704 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 11:51:09.148837 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 11:51:09.148917 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86938) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 11:51:09.149051 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86939) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 11:51:09.166642 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.166858 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 25 11:51:09.167197 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.167352 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.167500 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 25 11:51:09.167633 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 25 11:51:09.167763 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.167933 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.168065 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.168195 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 25 11:51:09.168195 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.168455 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.168585 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.168714 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.168843 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.169105 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.179965 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.180251 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.180499 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.180641 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.180774 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.180923 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.181056 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.181305 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.188869 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86938) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 11:51:09.189379 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86939) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 11:51:09.192255 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86938) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 11:51:09.192534 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.192786 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86939) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 11:51:09.192912 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.193051 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.193180 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.193334 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.193460 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.193589 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.193714 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.193860 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.193988 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.194112 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.194237 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.194362 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.194497 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.194623 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.194749 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.194874 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.195000 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.195143 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.195381 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.221459 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.223055 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86938) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 11:51:09.223332 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.224111 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.226659 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86939) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 11:51:09.227080 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.228635 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86938) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 11:51:09.228867 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.229146 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.234259 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86939) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 11:51:09.234542 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.234823 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.237041 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86938) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 11:51:09.237324 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.241771 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86938) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 11:51:09.242056 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.242167 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86939) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 11:51:09.242333 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.242445 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.242612 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.242896 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.243154 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.243421 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.243687 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.246888 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86939) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 11:51:09.247176 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.247581 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.247894 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.248171 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.248444 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.248712 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.248982 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.262428 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.262707 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.267282 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86938) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 11:51:09.267712 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.268013 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.270918 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.271212 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.272557 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86939) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 11:51:09.276457 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.276546 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86938) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 11:51:09.276752 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.280723 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86938) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 11:51:09.282277 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86939) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 11:51:09.284339 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.284647 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.284932 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.285212 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.285503 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.285786 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.286005 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86939) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 11:51:09.289624 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.289929 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.290207 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.290492 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.290765 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.291048 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.305158 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86938) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 11:51:09.305443 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.305708 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.305970 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.310479 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86939) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 11:51:09.310762 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.311026 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.311288 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.313875 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.315579 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.315889 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.318926 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86938) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 11:51:09.319157 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.319240 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.319474 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.319752 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.320164 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.320888 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.321166 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.324238 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86939) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 11:51:09.324517 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.324795 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.325115 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.325544 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.333462 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86938) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 11:51:09.333740 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.334019 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.334296 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.334582 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.334857 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.335142 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.338857 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86939) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 11:51:09.339135 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.339411 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.339688 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.339992 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.340269 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.340560 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.353430 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86938) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 11:51:09.356673 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86938) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 11:51:09.359359 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86939) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 11:51:09.360572 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.362179 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.362609 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86939) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 11:51:09.363875 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86938) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 11:51:09.365307 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.365598 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.365937 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.367541 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.369180 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86939) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 11:51:09.370620 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.370910 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.372897 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.374485 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86938) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 11:51:09.377733 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.378027 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.378234 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.378382 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.378585 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.379850 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86939) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 11:51:09.383071 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.383362 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.383651 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.383954 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.387717 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86938) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 11:51:09.388544 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.388832 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.393601 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86939) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 11:51:09.393889 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.394166 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.396638 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86938) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 11:51:09.396926 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.397206 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.397481 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.397749 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.398024 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.398302 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.398569 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.398855 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.399121 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.399741 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.400030 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.400302 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.400563 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86938) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.402224 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86939) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 11:51:09.402501 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.402787 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.403064 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.403336 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.403605 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.404433 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.404708 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.405001 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.405270 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.405637 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.405900 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.406172 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.406433 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86939) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 11:51:09.438447 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55c1394369c0 pid: 86938 (default app) May 25 11:51:09.441780 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158b272-090e-43ef-92c3-12e80b2c32f5 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:09.442071 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158b272-090e-43ef-92c3-12e80b2c32f5 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:09.442351 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158b272-090e-43ef-92c3-12e80b2c32f5 None None] PATH_INFO: `/v3` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:09.443842 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55c1394369c0 pid: 86939 (default app) May 25 11:51:09.446543 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 1/1] 10.222.0.44 () {50 vars in 791 bytes} [Wed May 25 11:51:09 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:17.631547 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6e965-30da-4968-8289-e13081d355fb None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:17.632182 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6e965-30da-4968-8289-e13081d355fb None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:17.632182 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6e965-30da-4968-8289-e13081d355fb None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:17.636323 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 1/2] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:51:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:51:17.642101 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2fd7c1-852e-453b-8f6d-d68837628bee None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:17.642539 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2fd7c1-852e-453b-8f6d-d68837628bee None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:17.642658 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2fd7c1-852e-453b-8f6d-d68837628bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:17.713714 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: INFO dbcounter [None req-2d2fd7c1-852e-453b-8f6d-d68837628bee None None] Registered counter for database keystone May 25 11:51:17.734906 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG oslo_db.sqlalchemy.engines [None req-2d2fd7c1-852e-453b-8f6d-d68837628bee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86938) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 11:51:17.740964 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writer thread running {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 11:51:18.025871 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG passlib.handlers.bcrypt [None req-2d2fd7c1-852e-453b-8f6d-d68837628bee None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86938) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 25 11:51:18.026281 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG passlib.handlers.bcrypt [None req-2d2fd7c1-852e-453b-8f6d-d68837628bee None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86938) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 25 11:51:18.082987 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-2d2fd7c1-852e-453b-8f6d-d68837628bee None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:51:18.084618 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-2d2fd7c1-852e-453b-8f6d-d68837628bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:51:18.204392 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 2/3] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:51:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 563 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 25 11:51:18.376047 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a6e965-30da-4968-8289-e13081d355fb None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:18.448308 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: INFO dbcounter [None req-f6a6e965-30da-4968-8289-e13081d355fb None None] Registered counter for database keystone May 25 11:51:18.467998 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG oslo_db.sqlalchemy.engines [None req-f6a6e965-30da-4968-8289-e13081d355fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86939) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 11:51:18.474122 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writer thread running {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 11:51:18.591308 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a6e965-30da-4968-8289-e13081d355fb None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:18.595611 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6aef05-337c-4648-b9f6-347d1f71e427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7103ef35356d4cd6a0f435bed6b1df47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:18.596298 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6aef05-337c-4648-b9f6-347d1f71e427 admin admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:18.596586 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6aef05-337c-4648-b9f6-347d1f71e427 admin admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:18.596864 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6aef05-337c-4648-b9f6-347d1f71e427 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:18.605059 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6aef05-337c-4648-b9f6-347d1f71e427 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:18.758769 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1a6aef05-337c-4648-b9f6-347d1f71e427 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 25 11:51:18.759425 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6aef05-337c-4648-b9f6-347d1f71e427 admin admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:18.769354 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 2/4] 10.222.0.44 () {58 vars in 1324 bytes} [Wed May 25 11:51:18 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 11:51:18.775685 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2fd7c1-852e-453b-8f6d-d68837628bee None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:18.790350 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2fd7c1-852e-453b-8f6d-d68837628bee None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:18.796933 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac34ea-9387-4fe5-8e01-dee462776516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7103ef35356d4cd6a0f435bed6b1df47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:18.798207 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac34ea-9387-4fe5-8e01-dee462776516 admin admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:18.798496 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac34ea-9387-4fe5-8e01-dee462776516 admin admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:18.798773 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac34ea-9387-4fe5-8e01-dee462776516 admin admin] PATH_INFO: `/v3/projects/7103ef35356d4cd6a0f435bed6b1df47` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:18.800327 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ac34ea-9387-4fe5-8e01-dee462776516 admin admin] RBAC: Authorizing `identity:get_project(project_id=7103ef35356d4cd6a0f435bed6b1df47)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:18.851956 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d0ac34ea-9387-4fe5-8e01-dee462776516 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 25 11:51:18.852300 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ac34ea-9387-4fe5-8e01-dee462776516 admin admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:18.856948 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 3/5] 10.222.0.44 () {56 vars in 1207 bytes} [Wed May 25 11:51:18 2022] GET /identity/v3/projects/7103ef35356d4cd6a0f435bed6b1df47 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:21.105759 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a09870-4107-4d55-903c-052f218e8d89 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:21.106293 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a09870-4107-4d55-903c-052f218e8d89 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:21.106396 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a09870-4107-4d55-903c-052f218e8d89 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:21.111160 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 3/6] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:51:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:51:21.116510 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1859e7af-1827-458d-ba4d-5019bf6e535b None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:21.116931 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1859e7af-1827-458d-ba4d-5019bf6e535b None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:21.117074 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1859e7af-1827-458d-ba4d-5019bf6e535b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:21.135436 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-1859e7af-1827-458d-ba4d-5019bf6e535b None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:51:21.136993 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-1859e7af-1827-458d-ba4d-5019bf6e535b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:51:21.144888 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 4/7] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:51:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 25 11:51:21.168054 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a09870-4107-4d55-903c-052f218e8d89 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:21.180706 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a09870-4107-4d55-903c-052f218e8d89 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:21.184994 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dad70df-ae21-4ca8-9a5f-762216513bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7103ef35356d4cd6a0f435bed6b1df47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:21.185671 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad70df-ae21-4ca8-9a5f-762216513bd0 admin admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:21.185960 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad70df-ae21-4ca8-9a5f-762216513bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:21.186240 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad70df-ae21-4ca8-9a5f-762216513bd0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:21.193960 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dad70df-ae21-4ca8-9a5f-762216513bd0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:21.195745 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dad70df-ae21-4ca8-9a5f-762216513bd0 admin admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:21.204541 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 4/8] 10.222.0.44 () {58 vars in 1324 bytes} [Wed May 25 11:51:21 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 25 11:51:21.211159 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1859e7af-1827-458d-ba4d-5019bf6e535b None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:21.220712 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1859e7af-1827-458d-ba4d-5019bf6e535b None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:21.225081 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee0806-9a33-4070-a6be-aa2738c99e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7103ef35356d4cd6a0f435bed6b1df47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:21.225944 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee0806-9a33-4070-a6be-aa2738c99e4c admin admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:21.226230 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee0806-9a33-4070-a6be-aa2738c99e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:21.226509 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee0806-9a33-4070-a6be-aa2738c99e4c admin admin] PATH_INFO: `/v3/users/c3f509c203864ee381a0b9ac7112de28` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:21.227932 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eee0806-9a33-4070-a6be-aa2738c99e4c admin admin] RBAC: Authorizing `identity:get_user(user_id=c3f509c203864ee381a0b9ac7112de28)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:21.229751 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eee0806-9a33-4070-a6be-aa2738c99e4c admin admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:21.231299 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 5/9] 10.222.0.44 () {56 vars in 1198 bytes} [Wed May 25 11:51:21 2022] GET /identity/v3/users/c3f509c203864ee381a0b9ac7112de28 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:23.577202 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15a9c7-00ae-4ce8-8ef3-dfa1834355e8 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:23.577696 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15a9c7-00ae-4ce8-8ef3-dfa1834355e8 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:23.577696 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15a9c7-00ae-4ce8-8ef3-dfa1834355e8 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:23.579019 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 5/10] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:51:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:51:23.584206 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3688ad7-b080-4c82-b483-d84e5f3b6e98 None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:23.584623 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3688ad7-b080-4c82-b483-d84e5f3b6e98 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:23.584768 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3688ad7-b080-4c82-b483-d84e5f3b6e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:23.598089 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb084dec-2e36-48a6-bb4c-ebbb33199917 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:23.598378 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb084dec-2e36-48a6-bb4c-ebbb33199917 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:23.598657 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb084dec-2e36-48a6-bb4c-ebbb33199917 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:23.599978 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 6/11] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:51:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 11:51:23.602156 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-d3688ad7-b080-4c82-b483-d84e5f3b6e98 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:51:23.603393 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-d3688ad7-b080-4c82-b483-d84e5f3b6e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:51:23.604822 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199ca8d-4c81-426b-9018-38f317a9e402 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:23.605109 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199ca8d-4c81-426b-9018-38f317a9e402 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:23.605390 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199ca8d-4c81-426b-9018-38f317a9e402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:23.643648 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG passlib.handlers.bcrypt [None req-2199ca8d-4c81-426b-9018-38f317a9e402 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86939) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 25 11:51:23.644111 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG passlib.handlers.bcrypt [None req-2199ca8d-4c81-426b-9018-38f317a9e402 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86939) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 25 11:51:23.682584 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 6/12] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:51:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 11:51:23.690701 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-2199ca8d-4c81-426b-9018-38f317a9e402 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:51:23.693622 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-2199ca8d-4c81-426b-9018-38f317a9e402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:51:23.708132 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3688ad7-b080-4c82-b483-d84e5f3b6e98 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:23.733772 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:23.799213 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 7/13] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:51:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 11:51:23.815588 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3688ad7-b080-4c82-b483-d84e5f3b6e98 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:23.821713 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2199ca8d-4c81-426b-9018-38f317a9e402 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:23.853065 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39707979-fbfa-40b2-95e8-0b2410646bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:23.853798 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39707979-fbfa-40b2-95e8-0b2410646bb7 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:23.854094 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39707979-fbfa-40b2-95e8-0b2410646bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:23.854377 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39707979-fbfa-40b2-95e8-0b2410646bb7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:23.865591 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39707979-fbfa-40b2-95e8-0b2410646bb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:51:23.876914 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-39707979-fbfa-40b2-95e8-0b2410646bb7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 11:51:23.876914 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:51:23.876914 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:51:23.876914 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:51:23.876914 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:51:23.876914 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:51:23.876914 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:51:23.876914 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:51:23.876914 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:51:23.876914 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:51:23.876914 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:51:23.876914 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:51:23.876914 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:51:23.876914 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:51:23.876914 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:51:23.876914 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:51:23.878103 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:51:23.878103 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:51:23.878103 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:51:23.878103 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:51:23.878103 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:51:23.878103 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:51:23.878103 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:51:23.878103 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:51:23.878103 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:51:23.878103 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:51:23.878103 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:51:23.878103 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:51:23.878103 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:51:23.878103 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:51:23.878103 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:51:23.878103 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:51:23.879227 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:51:23.879227 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:51:23.879227 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:51:23.879227 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:51:23.879227 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:51:23.879227 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:51:23.879227 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:51:23.879227 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:51:23.879227 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:51:23.879227 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:51:23.879227 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 11:51:23.879227 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:51:23.879227 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 7/14] 10.222.0.44 () {56 vars in 1096 bytes} [Wed May 25 11:51:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 11:51:23.883874 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39707979-fbfa-40b2-95e8-0b2410646bb7 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:23.923001 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2199ca8d-4c81-426b-9018-38f317a9e402 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:23.927006 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:23.961802 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf817a37-21be-4cb5-a3f3-7922f9b36612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:23.962944 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf817a37-21be-4cb5-a3f3-7922f9b36612 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:23.963233 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf817a37-21be-4cb5-a3f3-7922f9b36612 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:23.963512 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf817a37-21be-4cb5-a3f3-7922f9b36612 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:23.964964 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:23.983529 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39707979-fbfa-40b2-95e8-0b2410646bb7 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:24.017342 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b4a6d-944f-4aea-a298-e79a2ddc8425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:24.018043 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b4a6d-944f-4aea-a298-e79a2ddc8425 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:24.018315 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b4a6d-944f-4aea-a298-e79a2ddc8425 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:24.018598 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b4a6d-944f-4aea-a298-e79a2ddc8425 None admin] PATH_INFO: `/v3/roles` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:24.019363 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b4a6d-944f-4aea-a298-e79a2ddc8425 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:51:24.019673 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b4a6d-944f-4aea-a298-e79a2ddc8425 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:24.021286 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b4a6d-944f-4aea-a298-e79a2ddc8425 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:24.033133 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf817a37-21be-4cb5-a3f3-7922f9b36612 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:24.033989 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 8/15] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 25 11:51:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:51:24.034658 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf817a37-21be-4cb5-a3f3-7922f9b36612 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:24.039396 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b4a6d-944f-4aea-a298-e79a2ddc8425 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:24.130391 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 8/16] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 25 11:51:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 11:51:24.135888 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf817a37-21be-4cb5-a3f3-7922f9b36612 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:24.139037 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:24.139654 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b4a6d-944f-4aea-a298-e79a2ddc8425 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:24.175243 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41dbee4-1b02-4291-8ed9-df13abcfdc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:24.176163 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41dbee4-1b02-4291-8ed9-df13abcfdc72 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:24.176449 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41dbee4-1b02-4291-8ed9-df13abcfdc72 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:24.176728 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41dbee4-1b02-4291-8ed9-df13abcfdc72 None admin] PATH_INFO: `/v3/users/c3f509c203864ee381a0b9ac7112de28` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:24.177943 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41dbee4-1b02-4291-8ed9-df13abcfdc72 None admin] RBAC: Authorizing `identity:get_user(user_id=c3f509c203864ee381a0b9ac7112de28)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:24.179402 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41dbee4-1b02-4291-8ed9-df13abcfdc72 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:24.181084 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 9/17] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 25 11:51:24 2022] GET /identity/v3/users/c3f509c203864ee381a0b9ac7112de28 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:51:24.186873 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41dbee4-1b02-4291-8ed9-df13abcfdc72 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:24.203211 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:24.235118 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf817a37-21be-4cb5-a3f3-7922f9b36612 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:24.269237 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066de7ff-fcf6-42a7-869f-9c11ad951c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:24.270023 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066de7ff-fcf6-42a7-869f-9c11ad951c73 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:24.270300 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066de7ff-fcf6-42a7-869f-9c11ad951c73 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:24.270571 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066de7ff-fcf6-42a7-869f-9c11ad951c73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:24.285227 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41dbee4-1b02-4291-8ed9-df13abcfdc72 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:24.290084 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066de7ff-fcf6-42a7-869f-9c11ad951c73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:24.291543 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066de7ff-fcf6-42a7-869f-9c11ad951c73 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:24.311992 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-066de7ff-fcf6-42a7-869f-9c11ad951c73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:51:24.311992 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:51:24.311992 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:51:24.311992 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:51:24.311992 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:51:24.311992 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:51:24.311992 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:51:24.311992 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:51:24.311992 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:51:24.311992 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:51:24.311992 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:51:24.311992 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:51:24.311992 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 11:51:24.311992 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 11:51:24.311992 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 11:51:24.312824 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 11:51:24.312824 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:51:24.312824 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:51:24.312824 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:51:24.312824 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:51:24.312824 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:51:24.312824 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:51:24.312824 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:51:24.312824 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:51:24.312824 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:51:24.312824 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:51:24.312824 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:51:24.312824 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:51:24.312824 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:51:24.312824 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:51:24.312824 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:51:24.312824 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:51:24.313627 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 11:51:24.313627 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 11:51:24.313627 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:51:24.313627 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:51:24.313627 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 9/18] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:51:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 11:51:24.318186 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f5c184-e2e5-4f6f-ab36-b2e1240b86d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:24.318998 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f5c184-e2e5-4f6f-ab36-b2e1240b86d8 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:24.319348 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f5c184-e2e5-4f6f-ab36-b2e1240b86d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:24.319633 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f5c184-e2e5-4f6f-ab36-b2e1240b86d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:24.320395 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066de7ff-fcf6-42a7-869f-9c11ad951c73 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:24.320963 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f5c184-e2e5-4f6f-ab36-b2e1240b86d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:24.322410 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f5c184-e2e5-4f6f-ab36-b2e1240b86d8 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:24.324084 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 10/19] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:51:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:51:24.330128 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f5c184-e2e5-4f6f-ab36-b2e1240b86d8 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:24.376763 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:24.410348 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:24.422462 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066de7ff-fcf6-42a7-869f-9c11ad951c73 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:24.429759 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f5c184-e2e5-4f6f-ab36-b2e1240b86d8 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:24.455374 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21169b1d-5ff7-4ac2-8946-68a0e46839a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:24.456056 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21169b1d-5ff7-4ac2-8946-68a0e46839a7 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:24.456337 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21169b1d-5ff7-4ac2-8946-68a0e46839a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:24.456610 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21169b1d-5ff7-4ac2-8946-68a0e46839a7 None admin] PATH_INFO: `/v3/domains` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:24.457380 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21169b1d-5ff7-4ac2-8946-68a0e46839a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:51:24.457714 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21169b1d-5ff7-4ac2-8946-68a0e46839a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:24.459122 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21169b1d-5ff7-4ac2-8946-68a0e46839a7 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:24.463847 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea0f5b7-124e-4969-9271-ed9654b606e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:24.464508 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea0f5b7-124e-4969-9271-ed9654b606e1 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:24.464800 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea0f5b7-124e-4969-9271-ed9654b606e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:24.465082 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea0f5b7-124e-4969-9271-ed9654b606e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:24.465911 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea0f5b7-124e-4969-9271-ed9654b606e1 None admin] RBAC: Adding query filter params (role.id=2fe5c1214bcc4c1bafa5a4545161518d, scope.domain.id=default, user.id=c3f509c203864ee381a0b9ac7112de28) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:51:24.466225 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea0f5b7-124e-4969-9271-ed9654b606e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:24.467693 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea0f5b7-124e-4969-9271-ed9654b606e1 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:24.475354 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 11/20] 10.222.0.44 () {56 vars in 1322 bytes} [Wed May 25 11:51:24 2022] GET /identity/v3/role_assignments?user.id=c3f509c203864ee381a0b9ac7112de28&scope.domain.id=default&role.id=2fe5c1214bcc4c1bafa5a4545161518d => generated 233 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:51:24.476175 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 10/21] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 25 11:51:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:51:27.199666 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a66a2c-6e23-4282-8f96-be1bfede8e13 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:27.200655 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a66a2c-6e23-4282-8f96-be1bfede8e13 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:27.201657 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a66a2c-6e23-4282-8f96-be1bfede8e13 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:27.203211 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 12/22] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:51:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:51:27.209287 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f98b6-5813-4b41-937a-ee99488bef82 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:27.209711 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f98b6-5813-4b41-937a-ee99488bef82 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:27.209894 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f98b6-5813-4b41-937a-ee99488bef82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:27.222725 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78b6d0-54a9-436b-9cb7-ac5a6816301d None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:27.223292 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78b6d0-54a9-436b-9cb7-ac5a6816301d None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:27.223767 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78b6d0-54a9-436b-9cb7-ac5a6816301d None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:27.225370 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 13/23] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:51:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 11:51:27.237117 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-261f98b6-5813-4b41-937a-ee99488bef82 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:51:27.238319 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-261f98b6-5813-4b41-937a-ee99488bef82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:51:27.250440 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d429b50-6870-4717-8774-c4728b5f4286 None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:27.251010 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d429b50-6870-4717-8774-c4728b5f4286 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:27.251484 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d429b50-6870-4717-8774-c4728b5f4286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:27.283445 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-0d429b50-6870-4717-8774-c4728b5f4286 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:51:27.285016 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-0d429b50-6870-4717-8774-c4728b5f4286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:51:27.345244 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 11/24] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:51:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 11:51:27.348656 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c107d81-33e5-48f2-9da9-b4fc382ce606 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:27.348962 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c107d81-33e5-48f2-9da9-b4fc382ce606 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:27.349246 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c107d81-33e5-48f2-9da9-b4fc382ce606 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:27.351481 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 12/25] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:51:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:51:27.355873 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e3716-8685-4346-b627-43de5e35a509 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:27.356160 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e3716-8685-4346-b627-43de5e35a509 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:27.356434 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e3716-8685-4346-b627-43de5e35a509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:27.389335 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-365e3716-8685-4346-b627-43de5e35a509 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:51:27.394622 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-365e3716-8685-4346-b627-43de5e35a509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:51:27.418455 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 14/26] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:51:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 11:51:27.419395 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d429b50-6870-4717-8774-c4728b5f4286 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:27.488648 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:27.534570 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 13/27] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:51:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 11:51:27.535897 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e3716-8685-4346-b627-43de5e35a509 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:27.564145 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:27.613521 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d429b50-6870-4717-8774-c4728b5f4286 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:27.659550 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce98fe4e-e59d-45f7-98e2-e53968686d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:27.661628 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98fe4e-e59d-45f7-98e2-e53968686d19 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:27.662112 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98fe4e-e59d-45f7-98e2-e53968686d19 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:27.662538 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98fe4e-e59d-45f7-98e2-e53968686d19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:27.677666 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce98fe4e-e59d-45f7-98e2-e53968686d19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:27.679832 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce98fe4e-e59d-45f7-98e2-e53968686d19 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:27.691658 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e3716-8685-4346-b627-43de5e35a509 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:27.703652 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-ce98fe4e-e59d-45f7-98e2-e53968686d19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:51:27.703652 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:51:27.703652 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:51:27.703652 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:51:27.703652 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:51:27.703652 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:51:27.703652 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:51:27.703652 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:51:27.703652 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:51:27.703652 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:51:27.703652 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:51:27.703652 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:51:27.703652 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 11:51:27.703652 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 11:51:27.703652 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 11:51:27.704585 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 11:51:27.704585 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:51:27.704585 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:51:27.704585 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:51:27.704585 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:51:27.704585 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:51:27.704585 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:51:27.704585 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:51:27.704585 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:51:27.704585 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:51:27.704585 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:51:27.704585 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:51:27.704585 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:51:27.704585 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:51:27.704585 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:51:27.704585 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:51:27.704585 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:51:27.705379 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 11:51:27.705379 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 11:51:27.705379 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:51:27.705379 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:51:27.705379 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 15/28] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:51:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:51:27.705668 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce98fe4e-e59d-45f7-98e2-e53968686d19 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:27.730608 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e2a07f-d68e-4320-99b8-17537ee64430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:27.731629 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2a07f-d68e-4320-99b8-17537ee64430 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:27.732678 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2a07f-d68e-4320-99b8-17537ee64430 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:27.733304 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2a07f-d68e-4320-99b8-17537ee64430 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:27.745765 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e2a07f-d68e-4320-99b8-17537ee64430 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:51:27.756761 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-a7e2a07f-d68e-4320-99b8-17537ee64430 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 11:51:27.756761 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:51:27.756761 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:51:27.756761 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:51:27.756761 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:51:27.756761 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:51:27.756761 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:51:27.756761 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:51:27.756761 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:51:27.756761 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:51:27.756761 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:51:27.756761 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:51:27.756761 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:51:27.756761 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:51:27.756761 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:51:27.756761 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:51:27.757630 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:51:27.757630 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:51:27.757630 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:51:27.757630 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:51:27.757630 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:51:27.757630 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:51:27.757630 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:51:27.757630 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:51:27.757630 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:51:27.757630 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:51:27.757630 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:51:27.757630 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:51:27.757630 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:51:27.757630 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:51:27.757630 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:51:27.757630 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:51:27.759060 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:51:27.759060 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:51:27.759060 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:51:27.759060 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:51:27.759060 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:51:27.759060 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:51:27.759060 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:51:27.759060 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:51:27.759060 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:51:27.759060 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:51:27.759060 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 11:51:27.759060 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:51:27.762735 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 14/29] 10.222.0.44 () {56 vars in 1096 bytes} [Wed May 25 11:51:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:51:27.764622 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd7a28-84b2-4229-84ed-3998fe80016b None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:27.765108 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd7a28-84b2-4229-84ed-3998fe80016b None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:27.765558 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd7a28-84b2-4229-84ed-3998fe80016b None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:27.767032 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 15/30] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:51:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:51:27.768135 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd7a28-84b2-4229-84ed-3998fe80016b None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:27.819233 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:27.844759 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce98fe4e-e59d-45f7-98e2-e53968686d19 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:27.874161 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:27.885102 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89344387-1574-4a69-b2a9-df60a372a22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:27.886102 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89344387-1574-4a69-b2a9-df60a372a22e None admin] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:27.886558 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89344387-1574-4a69-b2a9-df60a372a22e None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:27.887025 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89344387-1574-4a69-b2a9-df60a372a22e None admin] PATH_INFO: `/v3/roles` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:27.887978 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89344387-1574-4a69-b2a9-df60a372a22e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:27.889731 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89344387-1574-4a69-b2a9-df60a372a22e None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:27.900955 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd7a28-84b2-4229-84ed-3998fe80016b None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:27.938932 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9283d4-e2b0-4093-bcc1-5be7353c8d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:27.939641 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9283d4-e2b0-4093-bcc1-5be7353c8d4d None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:27.939963 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9283d4-e2b0-4093-bcc1-5be7353c8d4d None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:27.940237 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9283d4-e2b0-4093-bcc1-5be7353c8d4d None admin] PATH_INFO: `/v3/domains` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:27.941025 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9283d4-e2b0-4093-bcc1-5be7353c8d4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:51:27.941331 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9283d4-e2b0-4093-bcc1-5be7353c8d4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:27.942752 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9283d4-e2b0-4093-bcc1-5be7353c8d4d None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:27.954366 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 16/31] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 25 11:51:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:27.955171 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9283d4-e2b0-4093-bcc1-5be7353c8d4d None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:28.030398 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 16/32] 10.222.0.44 () {60 vars in 1131 bytes} [Wed May 25 11:51:27 2022] POST /identity/v3/roles => generated 219 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 11:51:28.032592 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a036e3a-e714-4284-ae4c-e202294807ac None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:28.033440 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a036e3a-e714-4284-ae4c-e202294807ac None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:28.034338 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a036e3a-e714-4284-ae4c-e202294807ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:28.053169 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:28.059744 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9283d4-e2b0-4093-bcc1-5be7353c8d4d None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:28.063572 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-2a036e3a-e714-4284-ae4c-e202294807ac None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:51:28.065514 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-2a036e3a-e714-4284-ae4c-e202294807ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:51:28.102410 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb708a4d-6c1b-4263-a5b7-9b7e0d8411e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:28.103617 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb708a4d-6c1b-4263-a5b7-9b7e0d8411e0 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:28.104140 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb708a4d-6c1b-4263-a5b7-9b7e0d8411e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:28.105486 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb708a4d-6c1b-4263-a5b7-9b7e0d8411e0 None admin] PATH_INFO: `/v3/roles` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:28.106665 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb708a4d-6c1b-4263-a5b7-9b7e0d8411e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:51:28.110173 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb708a4d-6c1b-4263-a5b7-9b7e0d8411e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:28.112669 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb708a4d-6c1b-4263-a5b7-9b7e0d8411e0 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:28.144854 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 17/33] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 25 11:51:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:28.146049 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb708a4d-6c1b-4263-a5b7-9b7e0d8411e0 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:28.205990 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 17/34] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:51:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 11:51:28.206885 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a036e3a-e714-4284-ae4c-e202294807ac None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:28.353141 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb708a4d-6c1b-4263-a5b7-9b7e0d8411e0 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:28.357892 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a036e3a-e714-4284-ae4c-e202294807ac None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:28.385536 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:28.399818 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ee854-b7c8-4a0f-8bd2-bf4ac3601bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:28.399818 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ee854-b7c8-4a0f-8bd2-bf4ac3601bca None admin] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:28.399818 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ee854-b7c8-4a0f-8bd2-bf4ac3601bca None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:28.399818 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ee854-b7c8-4a0f-8bd2-bf4ac3601bca None admin] PATH_INFO: `/v3/projects` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:28.400196 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ee854-b7c8-4a0f-8bd2-bf4ac3601bca None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:28.400196 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ee854-b7c8-4a0f-8bd2-bf4ac3601bca None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:28.425854 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2683f4e-89c5-4800-9740-1a9cf85a516f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:28.426974 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2683f4e-89c5-4800-9740-1a9cf85a516f None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:28.427293 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2683f4e-89c5-4800-9740-1a9cf85a516f None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:28.427552 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2683f4e-89c5-4800-9740-1a9cf85a516f None admin] PATH_INFO: `/v3/users/c3f509c203864ee381a0b9ac7112de28` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:28.429225 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2683f4e-89c5-4800-9740-1a9cf85a516f None admin] RBAC: Authorizing `identity:get_user(user_id=c3f509c203864ee381a0b9ac7112de28)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:28.431107 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2683f4e-89c5-4800-9740-1a9cf85a516f None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:28.433241 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 18/35] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 25 11:51:28 2022] GET /identity/v3/users/c3f509c203864ee381a0b9ac7112de28 => generated 247 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:28.434215 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2683f4e-89c5-4800-9740-1a9cf85a516f None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:28.547448 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2683f4e-89c5-4800-9740-1a9cf85a516f None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:28.565663 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 18/36] 10.222.0.44 () {60 vars in 1141 bytes} [Wed May 25 11:51:28 2022] POST /identity/v3/projects => generated 301 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 11:51:28.566684 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ee854-b7c8-4a0f-8bd2-bf4ac3601bca None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:28.590339 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:28.636722 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754aac6-99da-42f4-b01b-cf17a211f8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:28.637339 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754aac6-99da-42f4-b01b-cf17a211f8a8 None admin] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:28.637689 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754aac6-99da-42f4-b01b-cf17a211f8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:28.637971 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754aac6-99da-42f4-b01b-cf17a211f8a8 None admin] PATH_INFO: `/v3/roles` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:28.639360 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e754aac6-99da-42f4-b01b-cf17a211f8a8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:28.640912 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e754aac6-99da-42f4-b01b-cf17a211f8a8 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:28.690548 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ee854-b7c8-4a0f-8bd2-bf4ac3601bca None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:28.693683 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 19/37] 10.222.0.44 () {60 vars in 1131 bytes} [Wed May 25 11:51:28 2022] POST /identity/v3/roles => generated 225 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 11:51:28.733732 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2e33c1-226b-4402-9d62-e85f0618be1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:28.734580 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e33c1-226b-4402-9d62-e85f0618be1b None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:28.734873 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e33c1-226b-4402-9d62-e85f0618be1b None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:28.735233 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e33c1-226b-4402-9d62-e85f0618be1b None admin] PATH_INFO: `/v3/domains/default` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:28.736739 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2e33c1-226b-4402-9d62-e85f0618be1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:28.738431 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2e33c1-226b-4402-9d62-e85f0618be1b None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:28.740473 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 19/38] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:51:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:28.746100 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754aac6-99da-42f4-b01b-cf17a211f8a8 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:28.818928 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:28.857965 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b1afa-c73b-40bd-b5b8-75d40cbf1150 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:28.858303 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b1afa-c73b-40bd-b5b8-75d40cbf1150 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:28.858536 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b1afa-c73b-40bd-b5b8-75d40cbf1150 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:28.860483 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 20/39] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:51:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:51:28.868689 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c6e88-2c86-443f-b21c-39420f94f3c8 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:28.868982 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c6e88-2c86-443f-b21c-39420f94f3c8 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:28.869252 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c6e88-2c86-443f-b21c-39420f94f3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:28.897325 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-076c6e88-2c86-443f-b21c-39420f94f3c8 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:51:28.899147 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-076c6e88-2c86-443f-b21c-39420f94f3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:51:28.915112 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754aac6-99da-42f4-b01b-cf17a211f8a8 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:28.978554 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd6ae9b-15e1-412c-abe5-291f1481711f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:28.978554 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6ae9b-15e1-412c-abe5-291f1481711f None admin] REQUEST_METHOD: `PUT` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:28.978554 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6ae9b-15e1-412c-abe5-291f1481711f None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:28.978554 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6ae9b-15e1-412c-abe5-291f1481711f None admin] PATH_INFO: `/v3/domains/default/users/c3f509c203864ee381a0b9ac7112de28/roles/2fe5c1214bcc4c1bafa5a4545161518d` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:28.982781 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd6ae9b-15e1-412c-abe5-291f1481711f None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=c3f509c203864ee381a0b9ac7112de28, role_id=2fe5c1214bcc4c1bafa5a4545161518d)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:28.984294 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd6ae9b-15e1-412c-abe5-291f1481711f None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:29.001281 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 20/40] 10.222.0.44 () {58 vars in 1361 bytes} [Wed May 25 11:51:28 2022] PUT /identity/v3/domains/default/users/c3f509c203864ee381a0b9ac7112de28/roles/2fe5c1214bcc4c1bafa5a4545161518d => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 11:51:29.002938 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244264ca-3923-4025-8f28-6a5390351b6a None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:29.003337 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244264ca-3923-4025-8f28-6a5390351b6a None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:29.003694 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244264ca-3923-4025-8f28-6a5390351b6a None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:29.005168 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 21/41] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:51:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:51:29.011192 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9baba-067d-45df-b334-0ba91c63961f None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:29.011583 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9baba-067d-45df-b334-0ba91c63961f None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:29.011998 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9baba-067d-45df-b334-0ba91c63961f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:29.021419 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 21/42] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:51:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 11:51:29.035966 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-e3b9baba-067d-45df-b334-0ba91c63961f None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:51:29.037607 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-e3b9baba-067d-45df-b334-0ba91c63961f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:51:29.047373 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c6e88-2c86-443f-b21c-39420f94f3c8 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:29.057730 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:29.114867 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 22/43] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:51:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 11:51:29.140510 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b9baba-067d-45df-b334-0ba91c63961f None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:29.160301 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c6e88-2c86-443f-b21c-39420f94f3c8 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:29.191074 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:29.207415 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb7bab5-3504-48fb-ba4f-0eaf340006f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:29.207415 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7bab5-3504-48fb-ba4f-0eaf340006f1 None admin] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:29.207694 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7bab5-3504-48fb-ba4f-0eaf340006f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:29.207979 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7bab5-3504-48fb-ba4f-0eaf340006f1 None admin] PATH_INFO: `/v3/roles` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:29.208755 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb7bab5-3504-48fb-ba4f-0eaf340006f1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:29.210159 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb7bab5-3504-48fb-ba4f-0eaf340006f1 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:29.226354 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 22/44] 10.222.0.44 () {60 vars in 1131 bytes} [Wed May 25 11:51:29 2022] POST /identity/v3/roles => generated 223 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 11:51:29.280204 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b9baba-067d-45df-b334-0ba91c63961f None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:29.317867 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea07cf22-d4e3-407c-b3ff-e4b9a7f228eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:29.318684 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07cf22-d4e3-407c-b3ff-e4b9a7f228eb None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:29.318974 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07cf22-d4e3-407c-b3ff-e4b9a7f228eb None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:29.319252 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07cf22-d4e3-407c-b3ff-e4b9a7f228eb None admin] PATH_INFO: `/v3/domains/default` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:29.320523 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea07cf22-d4e3-407c-b3ff-e4b9a7f228eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:29.322012 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea07cf22-d4e3-407c-b3ff-e4b9a7f228eb None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:29.323910 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 23/45] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:51:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:51:29.329536 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb7bab5-3504-48fb-ba4f-0eaf340006f1 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:29.402319 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:29.446290 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb7bab5-3504-48fb-ba4f-0eaf340006f1 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:29.480878 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46224b9-5e35-4717-b919-4c6f8688775e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:29.481544 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46224b9-5e35-4717-b919-4c6f8688775e None admin] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:29.481962 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46224b9-5e35-4717-b919-4c6f8688775e None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:29.482263 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46224b9-5e35-4717-b919-4c6f8688775e None admin] PATH_INFO: `/v3/projects` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:29.483029 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46224b9-5e35-4717-b919-4c6f8688775e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:29.484534 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46224b9-5e35-4717-b919-4c6f8688775e None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:29.509284 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 23/46] 10.222.0.44 () {60 vars in 1141 bytes} [Wed May 25 11:51:29 2022] POST /identity/v3/projects => generated 312 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 11:51:31.265911 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ecb59-a98b-460d-9305-db38264cbfb5 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:31.266410 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ecb59-a98b-460d-9305-db38264cbfb5 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:31.266521 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ecb59-a98b-460d-9305-db38264cbfb5 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:31.267856 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 24/47] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:51:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:51:31.272936 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ec589-93e2-4c04-a1de-9e4f3c9cc827 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:31.273328 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ec589-93e2-4c04-a1de-9e4f3c9cc827 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:31.273746 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ec589-93e2-4c04-a1de-9e4f3c9cc827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:31.290561 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-925ec589-93e2-4c04-a1de-9e4f3c9cc827 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:51:31.291772 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-925ec589-93e2-4c04-a1de-9e4f3c9cc827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:51:31.356577 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 24/48] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:51:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 11:51:31.381299 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ecb59-a98b-460d-9305-db38264cbfb5 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:31.481110 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ecb59-a98b-460d-9305-db38264cbfb5 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:31.482589 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:31.516116 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf37c1-49db-45d8-89f3-def9d5344900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:31.516924 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf37c1-49db-45d8-89f3-def9d5344900 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:31.517207 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf37c1-49db-45d8-89f3-def9d5344900 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:31.517485 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf37c1-49db-45d8-89f3-def9d5344900 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:31.528044 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbf37c1-49db-45d8-89f3-def9d5344900 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:51:31.535649 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-3fbf37c1-49db-45d8-89f3-def9d5344900 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 11:51:31.535649 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:51:31.535649 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:51:31.535649 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:51:31.535649 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:51:31.535649 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:51:31.535649 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:51:31.535649 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:51:31.535649 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:51:31.535649 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:51:31.535649 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:51:31.535649 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:51:31.535649 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:51:31.535649 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:51:31.535649 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:51:31.535649 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:51:31.536520 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:51:31.536520 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:51:31.536520 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:51:31.536520 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:51:31.536520 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:51:31.536520 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:51:31.536520 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:51:31.536520 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:51:31.536520 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:51:31.536520 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:51:31.536520 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:51:31.536520 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:51:31.536520 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:51:31.536520 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:51:31.536520 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:51:31.536520 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:51:31.537299 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:51:31.537299 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:51:31.537299 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:51:31.537299 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:51:31.537299 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:51:31.537299 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:51:31.537299 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:51:31.537299 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:51:31.537299 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:51:31.537299 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:51:31.537299 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 11:51:31.537299 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:51:31.537299 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 25/49] 10.222.0.44 () {56 vars in 1096 bytes} [Wed May 25 11:51:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:51:31.542607 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ec589-93e2-4c04-a1de-9e4f3c9cc827 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:31.594731 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:31.644845 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ec589-93e2-4c04-a1de-9e4f3c9cc827 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:31.677406 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2026fcd-7261-4989-bd45-ed51e4487992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:31.678071 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2026fcd-7261-4989-bd45-ed51e4487992 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:31.678360 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2026fcd-7261-4989-bd45-ed51e4487992 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:31.678641 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2026fcd-7261-4989-bd45-ed51e4487992 None admin] PATH_INFO: `/v3/roles` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:31.679390 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2026fcd-7261-4989-bd45-ed51e4487992 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:51:31.679700 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2026fcd-7261-4989-bd45-ed51e4487992 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:31.681116 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2026fcd-7261-4989-bd45-ed51e4487992 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:31.689623 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 25/50] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 25 11:51:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:51:31.695133 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf37c1-49db-45d8-89f3-def9d5344900 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:31.771404 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f886375d-1e77-4363-9569-2618acf99ed2 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:31.771621 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f886375d-1e77-4363-9569-2618acf99ed2 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:31.771944 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f886375d-1e77-4363-9569-2618acf99ed2 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:31.773313 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 26/51] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:51:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 11:51:31.779168 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06449f25-9bba-466e-9b8c-471d13267755 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:31.779455 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06449f25-9bba-466e-9b8c-471d13267755 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:31.779738 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06449f25-9bba-466e-9b8c-471d13267755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:31.793270 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf37c1-49db-45d8-89f3-def9d5344900 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:31.796797 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-06449f25-9bba-466e-9b8c-471d13267755 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:51:31.797999 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-06449f25-9bba-466e-9b8c-471d13267755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:51:31.830710 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0d7c6-b654-4a40-b9f0-f326fc858030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:31.830710 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0d7c6-b654-4a40-b9f0-f326fc858030 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:31.830710 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0d7c6-b654-4a40-b9f0-f326fc858030 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:31.830710 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0d7c6-b654-4a40-b9f0-f326fc858030 None admin] PATH_INFO: `/v3/users/c3f509c203864ee381a0b9ac7112de28` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:31.831110 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e0d7c6-b654-4a40-b9f0-f326fc858030 None admin] RBAC: Authorizing `identity:get_user(user_id=c3f509c203864ee381a0b9ac7112de28)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:31.832332 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e0d7c6-b654-4a40-b9f0-f326fc858030 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:31.833968 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 26/52] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 25 11:51:31 2022] GET /identity/v3/users/c3f509c203864ee381a0b9ac7112de28 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:31.839272 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0d7c6-b654-4a40-b9f0-f326fc858030 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:31.867491 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 27/53] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:51:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 11:51:31.873821 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:31.892682 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06449f25-9bba-466e-9b8c-471d13267755 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:31.935424 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:31.945444 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0d7c6-b654-4a40-b9f0-f326fc858030 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:31.978164 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7d7db1-be9d-4d9d-91d4-3d0d6515db9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:31.978961 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d7db1-be9d-4d9d-91d4-3d0d6515db9f None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:31.979249 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d7db1-be9d-4d9d-91d4-3d0d6515db9f None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:31.979534 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d7db1-be9d-4d9d-91d4-3d0d6515db9f None admin] PATH_INFO: `/v3/domains/default` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:31.980759 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7d7db1-be9d-4d9d-91d4-3d0d6515db9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:31.982767 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7d7db1-be9d-4d9d-91d4-3d0d6515db9f None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:31.984408 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 27/54] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:51:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:51:31.990018 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7d7db1-be9d-4d9d-91d4-3d0d6515db9f None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:31.991030 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06449f25-9bba-466e-9b8c-471d13267755 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:32.025868 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec7c3c9-5ff3-4598-b55b-c9b19508d408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:32.026592 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7c3c9-5ff3-4598-b55b-c9b19508d408 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:32.026884 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7c3c9-5ff3-4598-b55b-c9b19508d408 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:32.027168 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7c3c9-5ff3-4598-b55b-c9b19508d408 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:32.028360 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec7c3c9-5ff3-4598-b55b-c9b19508d408 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:32.029835 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec7c3c9-5ff3-4598-b55b-c9b19508d408 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:32.031444 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 28/55] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:51:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:51:32.036822 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec7c3c9-5ff3-4598-b55b-c9b19508d408 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:32.084579 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:32.088514 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7d7db1-be9d-4d9d-91d4-3d0d6515db9f None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:32.121681 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc1db8-eb7f-4fe6-bde0-b3477265b699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:32.122387 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc1db8-eb7f-4fe6-bde0-b3477265b699 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:32.123179 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc1db8-eb7f-4fe6-bde0-b3477265b699 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:32.123463 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc1db8-eb7f-4fe6-bde0-b3477265b699 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:32.124333 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fc1db8-eb7f-4fe6-bde0-b3477265b699 None admin] RBAC: Adding query filter params (role.id=2fe5c1214bcc4c1bafa5a4545161518d, scope.domain.id=default, user.id=c3f509c203864ee381a0b9ac7112de28) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:51:32.124651 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fc1db8-eb7f-4fe6-bde0-b3477265b699 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:32.126088 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fc1db8-eb7f-4fe6-bde0-b3477265b699 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:32.132089 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 28/56] 10.222.0.44 () {56 vars in 1322 bytes} [Wed May 25 11:51:31 2022] GET /identity/v3/role_assignments?user.id=c3f509c203864ee381a0b9ac7112de28&scope.domain.id=default&role.id=2fe5c1214bcc4c1bafa5a4545161518d => generated 530 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:51:32.136119 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec7c3c9-5ff3-4598-b55b-c9b19508d408 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:32.147936 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:32.174515 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb5e9d-e5b4-4b0d-a21a-6dbf618267df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:32.175198 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb5e9d-e5b4-4b0d-a21a-6dbf618267df None admin] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:32.175489 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb5e9d-e5b4-4b0d-a21a-6dbf618267df None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:32.175769 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb5e9d-e5b4-4b0d-a21a-6dbf618267df None admin] PATH_INFO: `/v3/projects` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:32.176529 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cb5e9d-e5b4-4b0d-a21a-6dbf618267df None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:32.178012 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cb5e9d-e5b4-4b0d-a21a-6dbf618267df None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:32.206120 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 29/57] 10.222.0.44 () {60 vars in 1140 bytes} [Wed May 25 11:51:32 2022] POST /identity/v3/projects => generated 298 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 11:51:34.470328 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153cf44-ae7c-4c33-8c69-37ad85978fe8 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:34.470817 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153cf44-ae7c-4c33-8c69-37ad85978fe8 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:34.470817 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153cf44-ae7c-4c33-8c69-37ad85978fe8 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:34.472228 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 29/58] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:51:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:51:34.477318 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee7116-3027-4a9e-8649-3e392f25e308 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:34.477733 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee7116-3027-4a9e-8649-3e392f25e308 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:34.477894 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee7116-3027-4a9e-8649-3e392f25e308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:34.494889 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-37ee7116-3027-4a9e-8649-3e392f25e308 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:51:34.496103 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-37ee7116-3027-4a9e-8649-3e392f25e308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:51:34.559998 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 30/59] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:51:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 11:51:34.585728 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e153cf44-ae7c-4c33-8c69-37ad85978fe8 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:34.684119 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e153cf44-ae7c-4c33-8c69-37ad85978fe8 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:34.716509 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc13f311-4dab-418c-8965-0f8f9dfa0d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:34.717291 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc13f311-4dab-418c-8965-0f8f9dfa0d81 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:34.717578 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc13f311-4dab-418c-8965-0f8f9dfa0d81 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:34.717859 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc13f311-4dab-418c-8965-0f8f9dfa0d81 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:34.719027 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc13f311-4dab-418c-8965-0f8f9dfa0d81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:34.720541 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc13f311-4dab-418c-8965-0f8f9dfa0d81 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:34.722058 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 30/60] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:51:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:34.727362 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee7116-3027-4a9e-8649-3e392f25e308 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:34.815932 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:34.824759 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee7116-3027-4a9e-8649-3e392f25e308 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:34.864791 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c453d7-e688-431c-a250-5c70391c7b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:34.865467 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c453d7-e688-431c-a250-5c70391c7b58 None admin] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:34.865755 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c453d7-e688-431c-a250-5c70391c7b58 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:34.866034 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c453d7-e688-431c-a250-5c70391c7b58 None admin] PATH_INFO: `/v3/users` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:34.866740 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c453d7-e688-431c-a250-5c70391c7b58 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:34.868229 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c453d7-e688-431c-a250-5c70391c7b58 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:34.893146 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 31/61] 10.222.0.44 () {60 vars in 1132 bytes} [Wed May 25 11:51:34 2022] POST /identity/v3/users => generated 275 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 11:51:38.411616 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d443c-8927-4e88-8d35-a39311ed52eb None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:38.412499 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d443c-8927-4e88-8d35-a39311ed52eb None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:38.412936 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d443c-8927-4e88-8d35-a39311ed52eb None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:38.414454 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 31/62] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:51:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:51:38.420501 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63284900-8cc2-4d4b-ac36-bb62015307d2 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:38.420932 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63284900-8cc2-4d4b-ac36-bb62015307d2 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:38.421114 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63284900-8cc2-4d4b-ac36-bb62015307d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:38.450342 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-63284900-8cc2-4d4b-ac36-bb62015307d2 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:51:38.451523 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-63284900-8cc2-4d4b-ac36-bb62015307d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:51:38.546119 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 32/63] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:51:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 11:51:38.593300 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d443c-8927-4e88-8d35-a39311ed52eb None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:38.615704 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab16e6e-399b-49e6-a4cf-67388dd1bd31 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:38.616780 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab16e6e-399b-49e6-a4cf-67388dd1bd31 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:38.617276 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab16e6e-399b-49e6-a4cf-67388dd1bd31 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:38.619591 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 33/64] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:51:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:51:38.627319 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721128f-94ab-4f46-aef9-03842d7182c7 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:38.627991 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721128f-94ab-4f46-aef9-03842d7182c7 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:38.628479 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721128f-94ab-4f46-aef9-03842d7182c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:38.647846 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:38.650620 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-4721128f-94ab-4f46-aef9-03842d7182c7 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:51:38.652201 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-4721128f-94ab-4f46-aef9-03842d7182c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:51:38.744545 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 34/65] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:51:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 11:51:38.746369 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29ecf5-013d-4e32-9447-1a26eb4d7c10 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:38.746672 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29ecf5-013d-4e32-9447-1a26eb4d7c10 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:38.746982 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29ecf5-013d-4e32-9447-1a26eb4d7c10 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:38.748945 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 35/66] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:51:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:51:38.754590 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f230f28-a099-47d6-9dae-5cf2510e6a87 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:38.754892 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f230f28-a099-47d6-9dae-5cf2510e6a87 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:38.755183 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f230f28-a099-47d6-9dae-5cf2510e6a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:38.765699 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d443c-8927-4e88-8d35-a39311ed52eb None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:38.773011 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-5f230f28-a099-47d6-9dae-5cf2510e6a87 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:51:38.774588 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-5f230f28-a099-47d6-9dae-5cf2510e6a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:51:38.776769 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:38.807837 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3845b1d2-e563-40ba-b9b1-7110b702596e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:38.808883 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845b1d2-e563-40ba-b9b1-7110b702596e None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:38.809489 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845b1d2-e563-40ba-b9b1-7110b702596e None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:38.809804 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845b1d2-e563-40ba-b9b1-7110b702596e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:38.826451 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3845b1d2-e563-40ba-b9b1-7110b702596e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:51:38.837231 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-3845b1d2-e563-40ba-b9b1-7110b702596e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 11:51:38.837231 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:51:38.837231 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:51:38.837231 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:51:38.837231 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:51:38.837231 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:51:38.837231 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:51:38.837231 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:51:38.837231 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:51:38.837231 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:51:38.837231 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:51:38.837231 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:51:38.837231 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:51:38.837231 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:51:38.837231 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:51:38.837231 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:51:38.838144 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:51:38.838144 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:51:38.838144 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:51:38.838144 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:51:38.838144 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:51:38.838144 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:51:38.838144 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:51:38.838144 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:51:38.838144 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:51:38.838144 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:51:38.838144 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:51:38.838144 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:51:38.838144 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:51:38.838144 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:51:38.838144 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:51:38.838144 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:51:38.838911 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:51:38.838911 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:51:38.838911 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:51:38.838911 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:51:38.838911 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:51:38.838911 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:51:38.838911 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:51:38.838911 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:51:38.838911 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:51:38.838911 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:51:38.838911 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 11:51:38.838911 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:51:38.839490 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 32/67] 10.222.0.44 () {56 vars in 1096 bytes} [Wed May 25 11:51:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:51:38.840292 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3845b1d2-e563-40ba-b9b1-7110b702596e None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:38.863170 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 36/68] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:51:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 11:51:38.864076 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f230f28-a099-47d6-9dae-5cf2510e6a87 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:38.957063 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:38.966803 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3845b1d2-e563-40ba-b9b1-7110b702596e None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:38.966938 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f230f28-a099-47d6-9dae-5cf2510e6a87 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:38.999145 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c5659-cd8a-414d-9828-92d0395964c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:38.999902 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c5659-cd8a-414d-9828-92d0395964c2 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:39.000183 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c5a6be-9b53-482a-b25c-df78509c7657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:39.000294 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c5659-cd8a-414d-9828-92d0395964c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:39.000478 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c5659-cd8a-414d-9828-92d0395964c2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:39.000849 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c5a6be-9b53-482a-b25c-df78509c7657 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:39.001138 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c5a6be-9b53-482a-b25c-df78509c7657 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:39.001420 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c5a6be-9b53-482a-b25c-df78509c7657 None admin] PATH_INFO: `/v3/roles` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:39.002175 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c5a6be-9b53-482a-b25c-df78509c7657 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:51:39.002525 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c5a6be-9b53-482a-b25c-df78509c7657 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:39.003965 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c5a6be-9b53-482a-b25c-df78509c7657 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:39.009348 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:39.011119 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2c5659-cd8a-414d-9828-92d0395964c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:51:39.013079 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 37/69] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 25 11:51:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:39.014695 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba45e9e-79fa-4781-928e-fc59e6c9224a None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:39.014996 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba45e9e-79fa-4781-928e-fc59e6c9224a None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:39.015297 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba45e9e-79fa-4781-928e-fc59e6c9224a None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:39.016547 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 38/70] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:51:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:51:39.017992 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb745d-5497-4025-ab2b-a8f0119c99b4 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:39.018288 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb745d-5497-4025-ab2b-a8f0119c99b4 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:39.018630 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb745d-5497-4025-ab2b-a8f0119c99b4 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:39.019054 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-db2c5659-cd8a-414d-9828-92d0395964c2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 11:51:39.019054 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:51:39.019054 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:51:39.019054 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:51:39.019054 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:51:39.019054 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:51:39.019054 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:51:39.019054 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:51:39.019054 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:51:39.019054 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:51:39.019054 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:51:39.019054 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:51:39.019054 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:51:39.019054 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:51:39.019054 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:51:39.019054 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:51:39.019898 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:51:39.019898 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:51:39.019898 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:51:39.019898 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:51:39.019898 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:51:39.019898 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:51:39.019898 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:51:39.019898 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:51:39.019898 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:51:39.019898 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:51:39.019898 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:51:39.019898 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:51:39.019898 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:51:39.019898 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:51:39.019898 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:51:39.019898 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:51:39.020666 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:51:39.020666 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:51:39.020666 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:51:39.020666 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:51:39.020666 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:51:39.020666 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:51:39.020666 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:51:39.020666 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:51:39.020666 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:51:39.020666 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:51:39.020666 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 11:51:39.020666 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:51:39.021239 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 39/71] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:51:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:51:39.021239 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb745d-5497-4025-ab2b-a8f0119c99b4 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:39.025475 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 33/72] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 25 11:51:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:51:39.026306 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c5659-cd8a-414d-9828-92d0395964c2 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:39.123177 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb745d-5497-4025-ab2b-a8f0119c99b4 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:39.123736 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c5659-cd8a-414d-9828-92d0395964c2 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:39.156001 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec548e95-e6b0-4af3-bd83-9f1f1e7fba07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:39.156154 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb6540-29a6-4f9d-8d27-6a7f4cd8be11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:39.156798 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec548e95-e6b0-4af3-bd83-9f1f1e7fba07 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:39.156989 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb6540-29a6-4f9d-8d27-6a7f4cd8be11 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:39.157079 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec548e95-e6b0-4af3-bd83-9f1f1e7fba07 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:39.157272 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb6540-29a6-4f9d-8d27-6a7f4cd8be11 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:39.157360 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec548e95-e6b0-4af3-bd83-9f1f1e7fba07 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:39.157550 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb6540-29a6-4f9d-8d27-6a7f4cd8be11 None admin] PATH_INFO: `/v3/users/c3f509c203864ee381a0b9ac7112de28` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:39.158714 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfb6540-29a6-4f9d-8d27-6a7f4cd8be11 None admin] RBAC: Authorizing `identity:get_user(user_id=c3f509c203864ee381a0b9ac7112de28)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:39.160194 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfb6540-29a6-4f9d-8d27-6a7f4cd8be11 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:39.161807 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 34/73] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 25 11:51:39 2022] GET /identity/v3/users/c3f509c203864ee381a0b9ac7112de28 => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:39.162927 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b229321-9998-4998-9ab6-0ee67c1b5b65 None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:39.163212 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b229321-9998-4998-9ab6-0ee67c1b5b65 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:39.163494 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b229321-9998-4998-9ab6-0ee67c1b5b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:39.169672 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec548e95-e6b0-4af3-bd83-9f1f1e7fba07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:51:39.177847 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-ec548e95-e6b0-4af3-bd83-9f1f1e7fba07 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 11:51:39.177847 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:51:39.177847 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:51:39.177847 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:51:39.177847 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:51:39.177847 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:51:39.177847 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:51:39.177847 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:51:39.177847 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:51:39.177847 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:51:39.177847 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:51:39.177847 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:51:39.177847 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:51:39.177847 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:51:39.177847 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:51:39.177847 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:51:39.178708 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:51:39.178708 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:51:39.178708 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:51:39.178708 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:51:39.178708 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:51:39.178708 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:51:39.178708 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:51:39.178708 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:51:39.178708 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:51:39.178708 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:51:39.178708 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:51:39.178708 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:51:39.178708 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:51:39.178708 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:51:39.178708 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:51:39.178708 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:51:39.179467 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:51:39.179467 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:51:39.179467 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:51:39.179467 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:51:39.179467 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:51:39.179467 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:51:39.179467 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:51:39.179467 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:51:39.179467 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:51:39.179467 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:51:39.179467 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 11:51:39.179467 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:51:39.179467 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 40/74] 10.222.0.44 () {56 vars in 1114 bytes} [Wed May 25 11:51:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:51:39.181073 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d8197-5e0f-41d1-b0b3-ec6041df74ec None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:39.181554 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d8197-5e0f-41d1-b0b3-ec6041df74ec None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:39.182349 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d8197-5e0f-41d1-b0b3-ec6041df74ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:39.182435 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-4b229321-9998-4998-9ab6-0ee67c1b5b65 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:51:39.183449 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-4b229321-9998-4998-9ab6-0ee67c1b5b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:51:39.198191 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-297d8197-5e0f-41d1-b0b3-ec6041df74ec None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:51:39.198339 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:39.199367 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-297d8197-5e0f-41d1-b0b3-ec6041df74ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:51:39.263540 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:39.276190 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 41/75] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:51:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 11:51:39.279219 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 35/76] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:51:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 11:51:39.279219 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b229321-9998-4998-9ab6-0ee67c1b5b65 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:39.279440 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d8197-5e0f-41d1-b0b3-ec6041df74ec None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:39.379223 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b229321-9998-4998-9ab6-0ee67c1b5b65 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:39.381496 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d8197-5e0f-41d1-b0b3-ec6041df74ec None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:39.413379 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa692c8-c66b-4e35-b09d-95697572358e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:39.414032 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa692c8-c66b-4e35-b09d-95697572358e None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:39.414321 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa692c8-c66b-4e35-b09d-95697572358e None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:39.414605 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa692c8-c66b-4e35-b09d-95697572358e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:39.415475 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c757fc7-5e13-4bb5-b6af-704862b5ae35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:39.416163 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c757fc7-5e13-4bb5-b6af-704862b5ae35 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:39.416452 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c757fc7-5e13-4bb5-b6af-704862b5ae35 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:39.416738 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c757fc7-5e13-4bb5-b6af-704862b5ae35 None admin] PATH_INFO: `/v3/roles` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:39.417495 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c757fc7-5e13-4bb5-b6af-704862b5ae35 None admin] RBAC: Adding query filter params (name=member) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:51:39.417807 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c757fc7-5e13-4bb5-b6af-704862b5ae35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:39.419235 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c757fc7-5e13-4bb5-b6af-704862b5ae35 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:39.427161 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 42/77] 10.222.0.44 () {56 vars in 1101 bytes} [Wed May 25 11:51:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:39.427987 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c757fc7-5e13-4bb5-b6af-704862b5ae35 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:39.432050 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:39.480207 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:39.482635 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa692c8-c66b-4e35-b09d-95697572358e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:39.483730 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa692c8-c66b-4e35-b09d-95697572358e None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:39.531197 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c757fc7-5e13-4bb5-b6af-704862b5ae35 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:39.564889 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8051178d-fa95-45b3-bf28-ad4466481e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:39.565560 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051178d-fa95-45b3-bf28-ad4466481e4f None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:39.565848 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051178d-fa95-45b3-bf28-ad4466481e4f None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:39.566129 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051178d-fa95-45b3-bf28-ad4466481e4f None admin] PATH_INFO: `/v3/roles` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:39.566871 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8051178d-fa95-45b3-bf28-ad4466481e4f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:51:39.567184 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8051178d-fa95-45b3-bf28-ad4466481e4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:39.568588 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8051178d-fa95-45b3-bf28-ad4466481e4f None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:39.576752 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 43/78] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 25 11:51:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:39.577340 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8051178d-fa95-45b3-bf28-ad4466481e4f None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:39.588503 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 36/79] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 25 11:51:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 11:51:39.589341 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa692c8-c66b-4e35-b09d-95697572358e None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:39.638912 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:39.676329 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8051178d-fa95-45b3-bf28-ad4466481e4f None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:39.690106 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:39.690363 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa692c8-c66b-4e35-b09d-95697572358e None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:39.709782 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d265f8f-4270-4f13-8491-759a14f94c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:39.710579 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d265f8f-4270-4f13-8491-759a14f94c81 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:39.710869 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d265f8f-4270-4f13-8491-759a14f94c81 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:39.711155 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d265f8f-4270-4f13-8491-759a14f94c81 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:39.721748 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d265f8f-4270-4f13-8491-759a14f94c81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:51:39.723941 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961d2cf-42fa-4240-8550-80ee810c4023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:39.724739 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961d2cf-42fa-4240-8550-80ee810c4023 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:39.725030 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961d2cf-42fa-4240-8550-80ee810c4023 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:39.725314 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961d2cf-42fa-4240-8550-80ee810c4023 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:39.726485 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e961d2cf-42fa-4240-8550-80ee810c4023 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:39.727976 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e961d2cf-42fa-4240-8550-80ee810c4023 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:39.729492 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-0d265f8f-4270-4f13-8491-759a14f94c81 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 11:51:39.729492 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:51:39.729492 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:51:39.729492 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:51:39.729492 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:51:39.729492 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:51:39.729492 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:51:39.729492 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:51:39.729492 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:51:39.729492 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:51:39.729492 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:51:39.729492 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:51:39.729492 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:51:39.729492 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:51:39.729492 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:51:39.729492 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:51:39.735659 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:51:39.735659 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:51:39.735659 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:51:39.735659 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:51:39.735659 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:51:39.735659 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:51:39.735659 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:51:39.735659 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:51:39.735659 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:51:39.735659 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:51:39.735659 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:51:39.735659 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:51:39.735659 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:51:39.735659 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:51:39.735659 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:51:39.735659 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:51:39.736458 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:51:39.736458 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:51:39.736458 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:51:39.736458 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:51:39.736458 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:51:39.736458 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:51:39.736458 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:51:39.736458 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:51:39.736458 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:51:39.736458 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:51:39.736458 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 11:51:39.736458 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:51:39.737031 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 37/80] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:51:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:39.737031 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961d2cf-42fa-4240-8550-80ee810c4023 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:39.737146 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 44/81] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 25 11:51:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:51:39.737146 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d265f8f-4270-4f13-8491-759a14f94c81 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:39.833258 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961d2cf-42fa-4240-8550-80ee810c4023 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:39.838230 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d265f8f-4270-4f13-8491-759a14f94c81 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:39.849844 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:39.868887 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32e2d3-ed5b-4bf0-9398-03df39b46832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:39.869768 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32e2d3-ed5b-4bf0-9398-03df39b46832 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:39.870055 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32e2d3-ed5b-4bf0-9398-03df39b46832 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:39.870333 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32e2d3-ed5b-4bf0-9398-03df39b46832 None admin] PATH_INFO: `/v3/users/d56e0746442f4c68951b0eae41c997d3` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:39.872240 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee17c31f-9f8c-4891-95c8-c363412d0744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:39.873118 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17c31f-9f8c-4891-95c8-c363412d0744 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:39.873406 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17c31f-9f8c-4891-95c8-c363412d0744 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:39.873689 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17c31f-9f8c-4891-95c8-c363412d0744 None admin] PATH_INFO: `/v3/users/d56e0746442f4c68951b0eae41c997d3` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:39.883980 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b32e2d3-ed5b-4bf0-9398-03df39b46832 None admin] RBAC: Authorizing `identity:get_user(user_id=d56e0746442f4c68951b0eae41c997d3)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:39.885720 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b32e2d3-ed5b-4bf0-9398-03df39b46832 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:39.887376 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 38/82] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 25 11:51:39 2022] GET /identity/v3/users/d56e0746442f4c68951b0eae41c997d3 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:39.888204 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32e2d3-ed5b-4bf0-9398-03df39b46832 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:39.888606 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee17c31f-9f8c-4891-95c8-c363412d0744 None admin] RBAC: Authorizing `identity:get_user(user_id=d56e0746442f4c68951b0eae41c997d3)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:39.890053 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee17c31f-9f8c-4891-95c8-c363412d0744 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:39.892082 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 45/83] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 25 11:51:39 2022] GET /identity/v3/users/d56e0746442f4c68951b0eae41c997d3 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:39.892496 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee17c31f-9f8c-4891-95c8-c363412d0744 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:39.923519 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:39.988308 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32e2d3-ed5b-4bf0-9398-03df39b46832 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:39.990264 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee17c31f-9f8c-4891-95c8-c363412d0744 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:40.020668 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef0b26-124c-44c5-9254-0cb22c7fccb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:40.021527 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef0b26-124c-44c5-9254-0cb22c7fccb0 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:40.021811 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef0b26-124c-44c5-9254-0cb22c7fccb0 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:40.022088 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef0b26-124c-44c5-9254-0cb22c7fccb0 None admin] PATH_INFO: `/v3/projects/0499f6b6a46a4da2bb2ceedf8b6843b6` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:40.022288 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc10fc3f-1314-4b08-aee6-24107c2c1e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:40.022953 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc10fc3f-1314-4b08-aee6-24107c2c1e07 None admin] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:40.023496 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc10fc3f-1314-4b08-aee6-24107c2c1e07 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:40.023603 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ef0b26-124c-44c5-9254-0cb22c7fccb0 None admin] RBAC: Authorizing `identity:get_project(project_id=0499f6b6a46a4da2bb2ceedf8b6843b6)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:40.023788 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc10fc3f-1314-4b08-aee6-24107c2c1e07 None admin] PATH_INFO: `/v3/users` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:40.024519 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc10fc3f-1314-4b08-aee6-24107c2c1e07 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:40.024967 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ef0b26-124c-44c5-9254-0cb22c7fccb0 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:40.025954 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc10fc3f-1314-4b08-aee6-24107c2c1e07 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:40.026628 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 39/84] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 25 11:51:39 2022] GET /identity/v3/projects/0499f6b6a46a4da2bb2ceedf8b6843b6 => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:40.027376 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef0b26-124c-44c5-9254-0cb22c7fccb0 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:40.046471 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 46/85] 10.222.0.44 () {60 vars in 1132 bytes} [Wed May 25 11:51:39 2022] POST /identity/v3/users => generated 289 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 11:51:40.047370 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc10fc3f-1314-4b08-aee6-24107c2c1e07 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:40.087888 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:40.147189 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:40.157900 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef0b26-124c-44c5-9254-0cb22c7fccb0 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:40.162024 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc10fc3f-1314-4b08-aee6-24107c2c1e07 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:40.203382 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ebca37-28e7-4548-96fb-d073a146b0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:40.204414 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ebca37-28e7-4548-96fb-d073a146b0cf None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:40.204884 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ebca37-28e7-4548-96fb-d073a146b0cf None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:40.205355 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ebca37-28e7-4548-96fb-d073a146b0cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:40.208334 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a70cf-482c-4f7f-9eca-6dabcab2f430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:40.209013 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a70cf-482c-4f7f-9eca-6dabcab2f430 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:40.209303 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a70cf-482c-4f7f-9eca-6dabcab2f430 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:40.209583 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a70cf-482c-4f7f-9eca-6dabcab2f430 None admin] PATH_INFO: `/v3/roles` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:40.210345 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8a70cf-482c-4f7f-9eca-6dabcab2f430 None admin] RBAC: Adding query filter params (name=member) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:51:40.210655 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8a70cf-482c-4f7f-9eca-6dabcab2f430 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:40.212090 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8a70cf-482c-4f7f-9eca-6dabcab2f430 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:40.226730 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 40/86] 10.222.0.44 () {56 vars in 1101 bytes} [Wed May 25 11:51:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:40.226730 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a70cf-482c-4f7f-9eca-6dabcab2f430 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:40.291496 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ebca37-28e7-4548-96fb-d073a146b0cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:40.293025 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ebca37-28e7-4548-96fb-d073a146b0cf None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:40.356415 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a70cf-482c-4f7f-9eca-6dabcab2f430 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:40.359724 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:40.392535 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:40.399621 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0192481e-028b-485d-9caa-daecff6cb726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:40.400478 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192481e-028b-485d-9caa-daecff6cb726 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:40.400769 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192481e-028b-485d-9caa-daecff6cb726 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:40.401055 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0192481e-028b-485d-9caa-daecff6cb726 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:40.407136 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 47/87] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 25 11:51:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 11:51:40.411705 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ebca37-28e7-4548-96fb-d073a146b0cf None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:40.478505 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0192481e-028b-485d-9caa-daecff6cb726 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:40.480062 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0192481e-028b-485d-9caa-daecff6cb726 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:40.539535 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ebca37-28e7-4548-96fb-d073a146b0cf None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:40.578995 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b14e35-c484-4667-8257-0974f9334925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:40.579834 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b14e35-c484-4667-8257-0974f9334925 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:40.579963 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b14e35-c484-4667-8257-0974f9334925 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:40.580246 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b14e35-c484-4667-8257-0974f9334925 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:40.581130 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b14e35-c484-4667-8257-0974f9334925 None admin] RBAC: Adding query filter params (role.id=2fe5c1214bcc4c1bafa5a4545161518d, scope.project.id=0499f6b6a46a4da2bb2ceedf8b6843b6, user.id=c3f509c203864ee381a0b9ac7112de28) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:51:40.581403 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b14e35-c484-4667-8257-0974f9334925 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:40.582866 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b14e35-c484-4667-8257-0974f9334925 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:40.591473 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 48/88] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 25 11:51:40 2022] GET /identity/v3/role_assignments?user.id=c3f509c203864ee381a0b9ac7112de28&scope.project.id=0499f6b6a46a4da2bb2ceedf8b6843b6&role.id=2fe5c1214bcc4c1bafa5a4545161518d => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:40.592255 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b14e35-c484-4667-8257-0974f9334925 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:40.604249 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 41/89] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 25 11:51:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 11:51:40.605804 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0192481e-028b-485d-9caa-daecff6cb726 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:40.618967 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:40.694102 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:40.792657 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0192481e-028b-485d-9caa-daecff6cb726 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:40.807777 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b14e35-c484-4667-8257-0974f9334925 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:40.840549 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8da152-bc3e-4a41-b50c-d388cc36611a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:40.842494 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8da152-bc3e-4a41-b50c-d388cc36611a None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:40.842782 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8da152-bc3e-4a41-b50c-d388cc36611a None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:40.843061 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8da152-bc3e-4a41-b50c-d388cc36611a None admin] PATH_INFO: `/v3/projects/0499f6b6a46a4da2bb2ceedf8b6843b6` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:40.844357 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8da152-bc3e-4a41-b50c-d388cc36611a None admin] RBAC: Authorizing `identity:get_project(project_id=0499f6b6a46a4da2bb2ceedf8b6843b6)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:40.849390 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8da152-bc3e-4a41-b50c-d388cc36611a None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:40.849390 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 42/90] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 25 11:51:40 2022] GET /identity/v3/projects/0499f6b6a46a4da2bb2ceedf8b6843b6 => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:40.849390 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8da152-bc3e-4a41-b50c-d388cc36611a None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:40.888518 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff81e67-442c-4887-a4ff-4b1a157d815f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:40.889627 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff81e67-442c-4887-a4ff-4b1a157d815f None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:40.890070 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff81e67-442c-4887-a4ff-4b1a157d815f None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:40.890483 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff81e67-442c-4887-a4ff-4b1a157d815f None admin] PATH_INFO: `/v3/users/d56e0746442f4c68951b0eae41c997d3` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:40.899927 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff81e67-442c-4887-a4ff-4b1a157d815f None admin] RBAC: Authorizing `identity:get_user(user_id=d56e0746442f4c68951b0eae41c997d3)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:40.901632 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff81e67-442c-4887-a4ff-4b1a157d815f None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:40.904139 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 49/91] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 25 11:51:40 2022] GET /identity/v3/users/d56e0746442f4c68951b0eae41c997d3 => generated 275 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:40.905095 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff81e67-442c-4887-a4ff-4b1a157d815f None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:40.937587 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:40.975053 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8da152-bc3e-4a41-b50c-d388cc36611a None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:41.017921 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5624510-30c5-4161-8b50-53ad618b8a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:41.019012 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5624510-30c5-4161-8b50-53ad618b8a9d None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:41.019305 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5624510-30c5-4161-8b50-53ad618b8a9d None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:41.019586 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5624510-30c5-4161-8b50-53ad618b8a9d None admin] PATH_INFO: `/v3/projects/0499f6b6a46a4da2bb2ceedf8b6843b6` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:41.021339 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5624510-30c5-4161-8b50-53ad618b8a9d None admin] RBAC: Authorizing `identity:get_project(project_id=0499f6b6a46a4da2bb2ceedf8b6843b6)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:41.022795 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5624510-30c5-4161-8b50-53ad618b8a9d None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:41.024949 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 43/92] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 25 11:51:40 2022] GET /identity/v3/projects/0499f6b6a46a4da2bb2ceedf8b6843b6 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:41.025880 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5624510-30c5-4161-8b50-53ad618b8a9d None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:41.146894 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5624510-30c5-4161-8b50-53ad618b8a9d None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:41.177775 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff81e67-442c-4887-a4ff-4b1a157d815f None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:41.187155 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa7d47-c7f4-4446-8260-5aac9eab9f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:41.187843 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa7d47-c7f4-4446-8260-5aac9eab9f55 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:41.188138 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa7d47-c7f4-4446-8260-5aac9eab9f55 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:41.188423 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa7d47-c7f4-4446-8260-5aac9eab9f55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:41.200716 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:41.227447 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:41.264208 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e3800-cb30-498c-be0e-c5799fee1372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:41.265210 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e3800-cb30-498c-be0e-c5799fee1372 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:41.265709 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e3800-cb30-498c-be0e-c5799fee1372 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:41.266183 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e3800-cb30-498c-be0e-c5799fee1372 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:41.275816 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728e3800-cb30-498c-be0e-c5799fee1372 None admin] RBAC: Adding query filter params (role.id=0bb7b8a3ae8f4d03a7f575ca8904963c, scope.project.id=0499f6b6a46a4da2bb2ceedf8b6843b6, user.id=d56e0746442f4c68951b0eae41c997d3) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:51:41.275954 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afa7d47-c7f4-4446-8260-5aac9eab9f55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:41.275954 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afa7d47-c7f4-4446-8260-5aac9eab9f55 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:41.276755 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728e3800-cb30-498c-be0e-c5799fee1372 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:41.279030 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728e3800-cb30-498c-be0e-c5799fee1372 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:41.288050 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 50/93] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 25 11:51:40 2022] GET /identity/v3/role_assignments?user.id=d56e0746442f4c68951b0eae41c997d3&scope.project.id=0499f6b6a46a4da2bb2ceedf8b6843b6&role.id=0bb7b8a3ae8f4d03a7f575ca8904963c => generated 259 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:41.289159 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e3800-cb30-498c-be0e-c5799fee1372 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:41.389547 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 44/94] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 25 11:51:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 11:51:41.395871 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa7d47-c7f4-4446-8260-5aac9eab9f55 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:41.450550 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e3800-cb30-498c-be0e-c5799fee1372 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:41.453041 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:41.490470 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5804e34e-7594-4306-88ad-3ed3a9420faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:41.491593 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804e34e-7594-4306-88ad-3ed3a9420faf None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:41.492098 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804e34e-7594-4306-88ad-3ed3a9420faf None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:41.492571 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804e34e-7594-4306-88ad-3ed3a9420faf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:41.493605 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5804e34e-7594-4306-88ad-3ed3a9420faf None admin] RBAC: Adding query filter params (role.id=1d75537a128747f180972029d0241cb4, scope.project.id=0499f6b6a46a4da2bb2ceedf8b6843b6, user.id=d56e0746442f4c68951b0eae41c997d3) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:51:41.494155 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5804e34e-7594-4306-88ad-3ed3a9420faf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:41.496036 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5804e34e-7594-4306-88ad-3ed3a9420faf None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:41.502542 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 51/95] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 25 11:51:41 2022] GET /identity/v3/role_assignments?user.id=d56e0746442f4c68951b0eae41c997d3&scope.project.id=0499f6b6a46a4da2bb2ceedf8b6843b6&role.id=1d75537a128747f180972029d0241cb4 => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:41.524113 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa7d47-c7f4-4446-8260-5aac9eab9f55 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:41.565902 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53443a8-0abf-469a-9f34-625227b63c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:41.566796 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53443a8-0abf-469a-9f34-625227b63c57 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:41.567088 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53443a8-0abf-469a-9f34-625227b63c57 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:41.567370 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53443a8-0abf-469a-9f34-625227b63c57 None admin] PATH_INFO: `/v3/projects/77abaefbc4da43f484b31efb185532a8` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:41.568756 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53443a8-0abf-469a-9f34-625227b63c57 None admin] RBAC: Authorizing `identity:get_project(project_id=77abaefbc4da43f484b31efb185532a8)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:41.570253 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53443a8-0abf-469a-9f34-625227b63c57 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:41.572070 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 45/96] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 25 11:51:41 2022] GET /identity/v3/projects/77abaefbc4da43f484b31efb185532a8 => generated 312 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:51:41.578787 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5804e34e-7594-4306-88ad-3ed3a9420faf None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:41.644104 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:41.696849 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5804e34e-7594-4306-88ad-3ed3a9420faf None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:41.733714 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd081053-55bb-4c2a-be96-b4ee32e93b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:41.734312 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd081053-55bb-4c2a-be96-b4ee32e93b6d None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:41.734602 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd081053-55bb-4c2a-be96-b4ee32e93b6d None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:41.734883 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd081053-55bb-4c2a-be96-b4ee32e93b6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:41.735735 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd081053-55bb-4c2a-be96-b4ee32e93b6d None admin] RBAC: Adding query filter params (role.id=0bb7b8a3ae8f4d03a7f575ca8904963c, scope.project.id=77abaefbc4da43f484b31efb185532a8, user.id=d56e0746442f4c68951b0eae41c997d3) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:51:41.736086 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd081053-55bb-4c2a-be96-b4ee32e93b6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:41.737567 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd081053-55bb-4c2a-be96-b4ee32e93b6d None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:41.743996 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 52/97] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 25 11:51:41 2022] GET /identity/v3/role_assignments?user.id=d56e0746442f4c68951b0eae41c997d3&scope.project.id=77abaefbc4da43f484b31efb185532a8&role.id=0bb7b8a3ae8f4d03a7f575ca8904963c => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:43.218505 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057c870-39f9-4e0f-9b9d-a2b36611ba87 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:43.219459 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057c870-39f9-4e0f-9b9d-a2b36611ba87 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:43.219994 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057c870-39f9-4e0f-9b9d-a2b36611ba87 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:43.221590 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 46/98] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:51:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:51:43.226858 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67367d-57cf-40bf-bbf6-9f8968c407c4 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:43.227655 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67367d-57cf-40bf-bbf6-9f8968c407c4 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:43.228163 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67367d-57cf-40bf-bbf6-9f8968c407c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:43.249913 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-2a67367d-57cf-40bf-bbf6-9f8968c407c4 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:51:43.253072 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-2a67367d-57cf-40bf-bbf6-9f8968c407c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:51:43.339234 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 53/99] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:51:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 11:51:43.378047 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8057c870-39f9-4e0f-9b9d-a2b36611ba87 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:43.421555 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc04e7c-f7d0-4fd7-a4ea-d2e570cec9d4 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:43.422209 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc04e7c-f7d0-4fd7-a4ea-d2e570cec9d4 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:43.422831 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc04e7c-f7d0-4fd7-a4ea-d2e570cec9d4 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:43.424510 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 54/100] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:51:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 11:51:43.429950 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51062d-edae-4d15-ad24-5f1b07bcb311 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:43.430454 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51062d-edae-4d15-ad24-5f1b07bcb311 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:43.430946 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51062d-edae-4d15-ad24-5f1b07bcb311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:43.457852 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-5b51062d-edae-4d15-ad24-5f1b07bcb311 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:51:43.460930 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-5b51062d-edae-4d15-ad24-5f1b07bcb311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:51:43.540163 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:43.580523 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8057c870-39f9-4e0f-9b9d-a2b36611ba87 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:43.598586 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:43.612983 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 55/101] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:51:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 11:51:43.617642 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a2e47-7b54-43ab-ae13-4667444b0b8f None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:43.617948 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a2e47-7b54-43ab-ae13-4667444b0b8f None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:43.618231 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a2e47-7b54-43ab-ae13-4667444b0b8f None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:43.619539 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 56/102] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:51:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:51:43.625814 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690a8da-3a05-41cc-afef-225eea1de4fd None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:43.626105 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690a8da-3a05-41cc-afef-225eea1de4fd None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:43.626387 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690a8da-3a05-41cc-afef-225eea1de4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:43.652048 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d9f82-9a2f-4e21-b7f6-f62af965ed2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:43.652863 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d9f82-9a2f-4e21-b7f6-f62af965ed2c None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:43.653188 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d9f82-9a2f-4e21-b7f6-f62af965ed2c None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:43.653470 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d9f82-9a2f-4e21-b7f6-f62af965ed2c None admin] PATH_INFO: `/v3/domains/default` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:43.655438 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901d9f82-9a2f-4e21-b7f6-f62af965ed2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:43.656949 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901d9f82-9a2f-4e21-b7f6-f62af965ed2c None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:43.658602 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 47/103] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:51:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:43.660077 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-3690a8da-3a05-41cc-afef-225eea1de4fd None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:51:43.661382 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-3690a8da-3a05-41cc-afef-225eea1de4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:51:43.663774 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d9f82-9a2f-4e21-b7f6-f62af965ed2c None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:43.818866 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d9f82-9a2f-4e21-b7f6-f62af965ed2c None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:43.842677 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 57/104] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:51:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 11:51:43.843583 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3690a8da-3a05-41cc-afef-225eea1de4fd None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:43.873548 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4bb9db-60b4-4699-ba94-affa970cde03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:43.874369 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4bb9db-60b4-4699-ba94-affa970cde03 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:43.874662 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4bb9db-60b4-4699-ba94-affa970cde03 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:43.874952 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4bb9db-60b4-4699-ba94-affa970cde03 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:43.896783 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4bb9db-60b4-4699-ba94-affa970cde03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:51:43.905696 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-bf4bb9db-60b4-4699-ba94-affa970cde03 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 11:51:43.905696 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:51:43.905696 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:51:43.905696 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:51:43.905696 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:51:43.905696 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:51:43.905696 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:51:43.905696 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:51:43.905696 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:51:43.905696 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:51:43.905696 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:51:43.905696 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:51:43.905696 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:51:43.905696 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:51:43.905696 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:51:43.905696 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:51:43.906586 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:51:43.906586 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:51:43.906586 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:51:43.906586 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:51:43.906586 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:51:43.906586 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:51:43.906586 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:51:43.906586 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:51:43.906586 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:51:43.906586 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:51:43.906586 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:51:43.906586 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:51:43.906586 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:51:43.906586 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:51:43.906586 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:51:43.906586 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:51:43.907397 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:51:43.907397 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:51:43.907397 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:51:43.907397 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:51:43.907397 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:51:43.907397 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:51:43.907397 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:51:43.907397 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:51:43.907397 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:51:43.907397 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:51:43.907397 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 11:51:43.907397 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:51:43.913353 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 48/105] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 25 11:51:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:51:43.914237 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4bb9db-60b4-4699-ba94-affa970cde03 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:43.982259 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3690a8da-3a05-41cc-afef-225eea1de4fd None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:43.982950 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:43.984776 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:44.055274 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f851d40-a6d6-4e4c-98f6-68b6359c47d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:44.055977 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f851d40-a6d6-4e4c-98f6-68b6359c47d8 None admin] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:44.056271 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f851d40-a6d6-4e4c-98f6-68b6359c47d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:44.056550 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f851d40-a6d6-4e4c-98f6-68b6359c47d8 None admin] PATH_INFO: `/v3/projects` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:44.057270 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f851d40-a6d6-4e4c-98f6-68b6359c47d8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:44.058727 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f851d40-a6d6-4e4c-98f6-68b6359c47d8 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:44.100446 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4bb9db-60b4-4699-ba94-affa970cde03 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:44.101195 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 58/106] 10.222.0.44 () {60 vars in 1141 bytes} [Wed May 25 11:51:43 2022] POST /identity/v3/projects => generated 302 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 11:51:44.102090 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f851d40-a6d6-4e4c-98f6-68b6359c47d8 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:44.176858 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8cdbfc-b4a0-4a7e-810e-4f4c3cede4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:44.176858 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8cdbfc-b4a0-4a7e-810e-4f4c3cede4cd None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:44.177140 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8cdbfc-b4a0-4a7e-810e-4f4c3cede4cd None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:44.177213 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8cdbfc-b4a0-4a7e-810e-4f4c3cede4cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:44.198433 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8cdbfc-b4a0-4a7e-810e-4f4c3cede4cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:51:44.214520 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-7e8cdbfc-b4a0-4a7e-810e-4f4c3cede4cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 11:51:44.214520 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:51:44.214520 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:51:44.214520 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:51:44.214520 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:51:44.214520 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:51:44.214520 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:51:44.214520 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:51:44.214520 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:51:44.214520 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:51:44.214520 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:51:44.214520 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:51:44.214520 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:51:44.214520 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:51:44.214520 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:51:44.214520 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:51:44.216022 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:51:44.216022 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:51:44.216022 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:51:44.216022 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:51:44.216022 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:51:44.216022 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:51:44.216022 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:51:44.216022 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:51:44.216022 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:51:44.216022 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:51:44.216022 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:51:44.216022 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:51:44.216022 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:51:44.216022 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:51:44.216022 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:51:44.216022 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:51:44.216806 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:51:44.216806 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:51:44.216806 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:51:44.216806 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:51:44.216806 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:51:44.216806 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:51:44.216806 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:51:44.216806 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:51:44.216806 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:51:44.216806 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:51:44.216806 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 11:51:44.216806 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:51:44.216806 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 49/107] 10.222.0.44 () {56 vars in 1096 bytes} [Wed May 25 11:51:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:51:44.224666 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8cdbfc-b4a0-4a7e-810e-4f4c3cede4cd None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:44.344703 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f851d40-a6d6-4e4c-98f6-68b6359c47d8 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:44.383530 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:44.394441 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8cdbfc-b4a0-4a7e-810e-4f4c3cede4cd None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:44.436600 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0cff5-4a7b-40d6-88c4-c5eb16595b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:44.437305 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0cff5-4a7b-40d6-88c4-c5eb16595b2c None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:44.437605 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0cff5-4a7b-40d6-88c4-c5eb16595b2c None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:44.437890 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0cff5-4a7b-40d6-88c4-c5eb16595b2c None admin] PATH_INFO: `/v3/roles` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:44.438672 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a0cff5-4a7b-40d6-88c4-c5eb16595b2c None admin] RBAC: Adding query filter params (name=reader) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:51:44.438984 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a0cff5-4a7b-40d6-88c4-c5eb16595b2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:44.440435 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a0cff5-4a7b-40d6-88c4-c5eb16595b2c None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:44.460629 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b035bc9-8514-45ba-9b2b-8c80bc5b4e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:44.461338 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b035bc9-8514-45ba-9b2b-8c80bc5b4e90 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:44.461631 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b035bc9-8514-45ba-9b2b-8c80bc5b4e90 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:44.461794 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 59/108] 10.222.0.44 () {56 vars in 1101 bytes} [Wed May 25 11:51:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:44.461945 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b035bc9-8514-45ba-9b2b-8c80bc5b4e90 None admin] PATH_INFO: `/v3/roles` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:44.462682 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b035bc9-8514-45ba-9b2b-8c80bc5b4e90 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:51:44.462998 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b035bc9-8514-45ba-9b2b-8c80bc5b4e90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:44.464532 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b035bc9-8514-45ba-9b2b-8c80bc5b4e90 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:44.468484 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0cff5-4a7b-40d6-88c4-c5eb16595b2c None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:44.473864 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 50/109] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 25 11:51:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:51:44.488799 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b035bc9-8514-45ba-9b2b-8c80bc5b4e90 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:44.509395 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:44.613271 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b035bc9-8514-45ba-9b2b-8c80bc5b4e90 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:44.674281 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04cb786-35c8-4950-bd15-d64252a3b206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:44.675185 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04cb786-35c8-4950-bd15-d64252a3b206 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:44.675475 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04cb786-35c8-4950-bd15-d64252a3b206 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:44.675755 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04cb786-35c8-4950-bd15-d64252a3b206 None admin] PATH_INFO: `/v3/users/c3f509c203864ee381a0b9ac7112de28` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:44.679824 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04cb786-35c8-4950-bd15-d64252a3b206 None admin] RBAC: Authorizing `identity:get_user(user_id=c3f509c203864ee381a0b9ac7112de28)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:44.681308 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04cb786-35c8-4950-bd15-d64252a3b206 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:44.682972 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 51/110] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 25 11:51:44 2022] GET /identity/v3/users/c3f509c203864ee381a0b9ac7112de28 => generated 247 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:51:44.688960 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04cb786-35c8-4950-bd15-d64252a3b206 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:44.726427 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:44.733440 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0cff5-4a7b-40d6-88c4-c5eb16595b2c None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:44.777906 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed5be4-fb6c-44d8-aa66-e12a605e352f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:44.779295 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed5be4-fb6c-44d8-aa66-e12a605e352f None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:44.781790 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed5be4-fb6c-44d8-aa66-e12a605e352f None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:44.782430 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed5be4-fb6c-44d8-aa66-e12a605e352f None admin] PATH_INFO: `/v3/users/194c46c6242d45c5b38351e3eb7ebd3a` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:44.799446 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeed5be4-fb6c-44d8-aa66-e12a605e352f None admin] RBAC: Authorizing `identity:get_user(user_id=194c46c6242d45c5b38351e3eb7ebd3a)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:44.801303 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeed5be4-fb6c-44d8-aa66-e12a605e352f None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:44.804283 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 60/111] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 25 11:51:44 2022] GET /identity/v3/users/194c46c6242d45c5b38351e3eb7ebd3a => generated 289 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:51:44.810773 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed5be4-fb6c-44d8-aa66-e12a605e352f None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:44.827297 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04cb786-35c8-4950-bd15-d64252a3b206 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:44.866863 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0514c0-498b-483c-988b-4305493454de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:44.868779 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0514c0-498b-483c-988b-4305493454de None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:44.871495 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0514c0-498b-483c-988b-4305493454de None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:44.872647 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0514c0-498b-483c-988b-4305493454de None admin] PATH_INFO: `/v3/projects/0499f6b6a46a4da2bb2ceedf8b6843b6` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:44.874121 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0514c0-498b-483c-988b-4305493454de None admin] RBAC: Authorizing `identity:get_project(project_id=0499f6b6a46a4da2bb2ceedf8b6843b6)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:44.877329 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0514c0-498b-483c-988b-4305493454de None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:44.881899 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 52/112] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 25 11:51:44 2022] GET /identity/v3/projects/0499f6b6a46a4da2bb2ceedf8b6843b6 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:51:44.882982 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ec4b9-3e50-4324-8b49-cf5f1fe2f69c None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:44.883272 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ec4b9-3e50-4324-8b49-cf5f1fe2f69c None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:44.883555 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ec4b9-3e50-4324-8b49-cf5f1fe2f69c None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:44.884825 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 53/113] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:51:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:51:44.893700 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533599f0-8bf9-444a-b314-012fc6a56d68 None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:44.893991 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533599f0-8bf9-444a-b314-012fc6a56d68 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:44.894328 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533599f0-8bf9-444a-b314-012fc6a56d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:44.926806 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-533599f0-8bf9-444a-b314-012fc6a56d68 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:51:44.930547 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-533599f0-8bf9-444a-b314-012fc6a56d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:51:44.943829 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:44.972580 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed5be4-fb6c-44d8-aa66-e12a605e352f None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:45.014086 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f978b-5a72-447e-bb92-87c73b0f9734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:45.014884 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f978b-5a72-447e-bb92-87c73b0f9734 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:45.015413 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f978b-5a72-447e-bb92-87c73b0f9734 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:45.015514 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 54/114] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:51:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 11:51:45.015599 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f978b-5a72-447e-bb92-87c73b0f9734 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:45.020576 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533599f0-8bf9-444a-b314-012fc6a56d68 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:45.050510 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:45.094114 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6f978b-5a72-447e-bb92-87c73b0f9734 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:45.095588 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6f978b-5a72-447e-bb92-87c73b0f9734 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:45.127267 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533599f0-8bf9-444a-b314-012fc6a56d68 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:45.162000 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9a22b-bc09-4b92-9739-2b3497e8a027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:45.162886 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9a22b-bc09-4b92-9739-2b3497e8a027 None admin] REQUEST_METHOD: `PUT` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:45.163172 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9a22b-bc09-4b92-9739-2b3497e8a027 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:45.163449 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9a22b-bc09-4b92-9739-2b3497e8a027 None admin] PATH_INFO: `/v3/projects/0499f6b6a46a4da2bb2ceedf8b6843b6/users/c3f509c203864ee381a0b9ac7112de28/roles/2fe5c1214bcc4c1bafa5a4545161518d` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:45.168113 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b9a22b-bc09-4b92-9739-2b3497e8a027 None admin] RBAC: Authorizing `identity:create_grant(project_id=0499f6b6a46a4da2bb2ceedf8b6843b6, user_id=c3f509c203864ee381a0b9ac7112de28, role_id=2fe5c1214bcc4c1bafa5a4545161518d)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:45.169626 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b9a22b-bc09-4b92-9739-2b3497e8a027 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:45.175755 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:45.187039 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 55/115] 10.222.0.44 () {58 vars in 1439 bytes} [Wed May 25 11:51:45 2022] PUT /identity/v3/projects/0499f6b6a46a4da2bb2ceedf8b6843b6/users/c3f509c203864ee381a0b9ac7112de28/roles/2fe5c1214bcc4c1bafa5a4545161518d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 11:51:45.188182 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91e84c-07ed-42bc-877c-e62e13fb1de0 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:45.188476 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91e84c-07ed-42bc-877c-e62e13fb1de0 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:45.188762 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91e84c-07ed-42bc-877c-e62e13fb1de0 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:45.190042 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 56/116] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:51:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:51:45.195563 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d3156-e412-4042-9f59-7f0e983edef0 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:45.195904 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d3156-e412-4042-9f59-7f0e983edef0 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:45.196164 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d3156-e412-4042-9f59-7f0e983edef0 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:45.197583 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 57/117] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:51:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:51:45.200580 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119d3156-e412-4042-9f59-7f0e983edef0 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:45.214112 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 61/118] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 25 11:51:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 11:51:45.216296 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0204c-55de-40f4-82c1-092ef6973a37 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:45.216816 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0204c-55de-40f4-82c1-092ef6973a37 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:45.217340 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0204c-55de-40f4-82c1-092ef6973a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:45.236675 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-03e0204c-55de-40f4-82c1-092ef6973a37 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:51:45.238327 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-03e0204c-55de-40f4-82c1-092ef6973a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:51:45.324483 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 62/119] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:51:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 11:51:45.326773 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61694686-b04a-43a1-8cfe-6d8cb8453cd3 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:45.327338 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61694686-b04a-43a1-8cfe-6d8cb8453cd3 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:45.327865 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61694686-b04a-43a1-8cfe-6d8cb8453cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:45.337431 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:45.350415 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-61694686-b04a-43a1-8cfe-6d8cb8453cd3 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:51:45.352540 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-61694686-b04a-43a1-8cfe-6d8cb8453cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:51:45.359277 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119d3156-e412-4042-9f59-7f0e983edef0 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:45.411014 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00744a1d-eee5-4873-97fa-9a43514bcd58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:45.411862 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00744a1d-eee5-4873-97fa-9a43514bcd58 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:45.412160 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00744a1d-eee5-4873-97fa-9a43514bcd58 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:45.412440 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00744a1d-eee5-4873-97fa-9a43514bcd58 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:45.426351 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00744a1d-eee5-4873-97fa-9a43514bcd58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:51:45.436725 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-00744a1d-eee5-4873-97fa-9a43514bcd58 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 11:51:45.436725 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:51:45.436725 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:51:45.436725 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:51:45.436725 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:51:45.436725 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:51:45.436725 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:51:45.436725 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:51:45.436725 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:51:45.436725 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:51:45.436725 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:51:45.436725 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:51:45.436725 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:51:45.436725 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:51:45.436725 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:51:45.436725 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:51:45.437582 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:51:45.437582 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:51:45.437582 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:51:45.437582 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:51:45.437582 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:51:45.437582 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:51:45.437582 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:51:45.437582 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:51:45.437582 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:51:45.437582 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:51:45.437582 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:51:45.437582 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:51:45.437582 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:51:45.437582 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:51:45.437582 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:51:45.437582 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:51:45.438351 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:51:45.438351 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:51:45.438351 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:51:45.438351 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:51:45.438351 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:51:45.438351 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:51:45.438351 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:51:45.438351 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:51:45.438351 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:51:45.438351 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:51:45.438351 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 11:51:45.438351 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:51:45.438937 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 63/120] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:51:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 11:51:45.438937 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61694686-b04a-43a1-8cfe-6d8cb8453cd3 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:45.444258 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 58/121] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 25 11:51:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:51:45.445211 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00744a1d-eee5-4873-97fa-9a43514bcd58 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:45.487769 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:45.555400 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61694686-b04a-43a1-8cfe-6d8cb8453cd3 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:45.562355 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00744a1d-eee5-4873-97fa-9a43514bcd58 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:45.589771 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626bdcf5-9692-4cf8-a829-69dd148f92c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:45.591307 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626bdcf5-9692-4cf8-a829-69dd148f92c3 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:45.591698 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626bdcf5-9692-4cf8-a829-69dd148f92c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:45.592057 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626bdcf5-9692-4cf8-a829-69dd148f92c3 None admin] PATH_INFO: `/v3/projects/0499f6b6a46a4da2bb2ceedf8b6843b6` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:45.593334 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626bdcf5-9692-4cf8-a829-69dd148f92c3 None admin] RBAC: Authorizing `identity:get_project(project_id=0499f6b6a46a4da2bb2ceedf8b6843b6)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:45.594844 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626bdcf5-9692-4cf8-a829-69dd148f92c3 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:45.596944 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 64/122] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 25 11:51:45 2022] GET /identity/v3/projects/0499f6b6a46a4da2bb2ceedf8b6843b6 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:45.597751 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626bdcf5-9692-4cf8-a829-69dd148f92c3 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:45.600477 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4682ec52-fde2-4fe6-bc64-db97cfaf19a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:45.601749 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682ec52-fde2-4fe6-bc64-db97cfaf19a2 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:45.602260 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682ec52-fde2-4fe6-bc64-db97cfaf19a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:45.602753 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682ec52-fde2-4fe6-bc64-db97cfaf19a2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:45.614855 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4682ec52-fde2-4fe6-bc64-db97cfaf19a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:51:45.623761 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-4682ec52-fde2-4fe6-bc64-db97cfaf19a2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 11:51:45.623761 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:51:45.623761 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:51:45.623761 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:51:45.623761 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:51:45.623761 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:51:45.623761 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:51:45.623761 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:51:45.623761 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:51:45.623761 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:51:45.623761 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:51:45.623761 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:51:45.623761 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:51:45.623761 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:51:45.623761 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:51:45.623761 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:51:45.624642 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:51:45.624642 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:51:45.624642 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:51:45.624642 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:51:45.624642 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:51:45.624642 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:51:45.624642 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:51:45.624642 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:51:45.624642 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:51:45.624642 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:51:45.624642 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:51:45.624642 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:51:45.624642 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:51:45.624642 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:51:45.624642 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:51:45.624642 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:51:45.625419 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:51:45.625419 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:51:45.625419 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:51:45.625419 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:51:45.625419 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:51:45.625419 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:51:45.625419 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:51:45.625419 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:51:45.625419 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:51:45.625419 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:51:45.625419 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 11:51:45.625419 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:51:45.628113 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 59/123] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 25 11:51:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:51:45.633046 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4682ec52-fde2-4fe6-bc64-db97cfaf19a2 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:45.639313 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:45.703461 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626bdcf5-9692-4cf8-a829-69dd148f92c3 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:45.705465 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:45.754464 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17dc869-8a0b-4421-b76f-b37a605b4554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:45.755521 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17dc869-8a0b-4421-b76f-b37a605b4554 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:45.756059 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17dc869-8a0b-4421-b76f-b37a605b4554 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:45.756591 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17dc869-8a0b-4421-b76f-b37a605b4554 None admin] PATH_INFO: `/v3/roles` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:45.757718 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17dc869-8a0b-4421-b76f-b37a605b4554 None admin] RBAC: Adding query filter params (name=member) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:51:45.758231 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17dc869-8a0b-4421-b76f-b37a605b4554 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:45.759954 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17dc869-8a0b-4421-b76f-b37a605b4554 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:45.767670 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4682ec52-fde2-4fe6-bc64-db97cfaf19a2 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:45.769521 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 65/124] 10.222.0.44 () {56 vars in 1101 bytes} [Wed May 25 11:51:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:45.776694 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17dc869-8a0b-4421-b76f-b37a605b4554 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:45.810647 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108f879-e9ba-4a1f-99da-13ea5270845b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:45.811622 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108f879-e9ba-4a1f-99da-13ea5270845b None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:45.811946 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108f879-e9ba-4a1f-99da-13ea5270845b None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:45.812342 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108f879-e9ba-4a1f-99da-13ea5270845b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:45.826102 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4108f879-e9ba-4a1f-99da-13ea5270845b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:51:45.837206 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-4108f879-e9ba-4a1f-99da-13ea5270845b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 11:51:45.837206 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:51:45.837206 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:51:45.837206 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:51:45.837206 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:51:45.837206 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:51:45.837206 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:51:45.837206 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:51:45.837206 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:51:45.837206 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:51:45.837206 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:51:45.837206 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:51:45.837206 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:51:45.837206 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:51:45.837206 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:51:45.837206 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:51:45.838424 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:51:45.838424 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:51:45.838424 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:51:45.838424 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:51:45.838424 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:51:45.838424 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:51:45.838424 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:51:45.838424 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:51:45.838424 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:51:45.838424 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:51:45.838424 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:51:45.838424 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:51:45.838424 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:51:45.838424 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:51:45.838424 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:51:45.838424 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:51:45.844487 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:51:45.844487 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:51:45.844487 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:51:45.844487 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:51:45.844487 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:51:45.844487 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:51:45.844487 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:51:45.844487 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:51:45.844487 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:51:45.844487 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:51:45.844487 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 11:51:45.844487 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:51:45.844487 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 60/125] 10.222.0.44 () {56 vars in 1114 bytes} [Wed May 25 11:51:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:51:45.844487 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108f879-e9ba-4a1f-99da-13ea5270845b None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:45.916676 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:45.922491 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17dc869-8a0b-4421-b76f-b37a605b4554 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:45.958659 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108f879-e9ba-4a1f-99da-13ea5270845b None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:45.965331 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d7e26-aefc-4b41-bb13-614aec9587cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:45.966824 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d7e26-aefc-4b41-bb13-614aec9587cb None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:45.967775 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d7e26-aefc-4b41-bb13-614aec9587cb None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:45.968311 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d7e26-aefc-4b41-bb13-614aec9587cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:45.969734 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8d7e26-aefc-4b41-bb13-614aec9587cb None admin] RBAC: Adding query filter params (role.id=038496e26bf34707a6fa4de9bc368de5, scope.project.id=0499f6b6a46a4da2bb2ceedf8b6843b6, user.id=194c46c6242d45c5b38351e3eb7ebd3a) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:51:45.970276 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8d7e26-aefc-4b41-bb13-614aec9587cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:45.972557 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8d7e26-aefc-4b41-bb13-614aec9587cb None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:45.979897 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 66/126] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 25 11:51:45 2022] GET /identity/v3/role_assignments?user.id=194c46c6242d45c5b38351e3eb7ebd3a&scope.project.id=0499f6b6a46a4da2bb2ceedf8b6843b6&role.id=038496e26bf34707a6fa4de9bc368de5 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:45.982167 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d7e26-aefc-4b41-bb13-614aec9587cb None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:46.001141 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b26602e-d7c9-4ee3-87f4-fb613756836b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:46.001847 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26602e-d7c9-4ee3-87f4-fb613756836b None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:46.002088 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26602e-d7c9-4ee3-87f4-fb613756836b None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:46.002368 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26602e-d7c9-4ee3-87f4-fb613756836b None admin] PATH_INFO: `/v3/roles` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:46.003124 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b26602e-d7c9-4ee3-87f4-fb613756836b None admin] RBAC: Adding query filter params (name=member) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:51:46.003434 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b26602e-d7c9-4ee3-87f4-fb613756836b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:46.005017 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b26602e-d7c9-4ee3-87f4-fb613756836b None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:46.019828 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 61/127] 10.222.0.44 () {56 vars in 1101 bytes} [Wed May 25 11:51:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:46.019828 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b26602e-d7c9-4ee3-87f4-fb613756836b None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:46.029629 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:46.129645 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d7e26-aefc-4b41-bb13-614aec9587cb None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:46.204076 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b26602e-d7c9-4ee3-87f4-fb613756836b None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:46.204534 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c4077-1d0d-4340-a5d8-9ebb5d952a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:46.205456 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c4077-1d0d-4340-a5d8-9ebb5d952a42 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:46.205749 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c4077-1d0d-4340-a5d8-9ebb5d952a42 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:46.206042 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c4077-1d0d-4340-a5d8-9ebb5d952a42 None admin] PATH_INFO: `/v3/users/d56e0746442f4c68951b0eae41c997d3` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:46.212784 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733c4077-1d0d-4340-a5d8-9ebb5d952a42 None admin] RBAC: Authorizing `identity:get_user(user_id=d56e0746442f4c68951b0eae41c997d3)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:46.214212 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733c4077-1d0d-4340-a5d8-9ebb5d952a42 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:46.216902 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 67/128] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 25 11:51:45 2022] GET /identity/v3/users/d56e0746442f4c68951b0eae41c997d3 => generated 275 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:46.217729 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c4077-1d0d-4340-a5d8-9ebb5d952a42 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:46.241806 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:46.250987 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80739f35-0075-49f1-9de0-5922dd4e9741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:46.251687 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80739f35-0075-49f1-9de0-5922dd4e9741 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:46.252017 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80739f35-0075-49f1-9de0-5922dd4e9741 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:46.252307 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80739f35-0075-49f1-9de0-5922dd4e9741 None admin] PATH_INFO: `/v3/roles` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:46.253085 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80739f35-0075-49f1-9de0-5922dd4e9741 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:51:46.253903 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80739f35-0075-49f1-9de0-5922dd4e9741 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:46.255422 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80739f35-0075-49f1-9de0-5922dd4e9741 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:46.266085 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 62/129] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 25 11:51:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:46.273749 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80739f35-0075-49f1-9de0-5922dd4e9741 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:46.395216 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80739f35-0075-49f1-9de0-5922dd4e9741 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:46.436162 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:46.447210 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c4077-1d0d-4340-a5d8-9ebb5d952a42 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:46.458770 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a6ef3-436e-4c20-9a7c-0fea6e0b16c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:46.459650 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a6ef3-436e-4c20-9a7c-0fea6e0b16c7 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:46.459957 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a6ef3-436e-4c20-9a7c-0fea6e0b16c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:46.460237 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a6ef3-436e-4c20-9a7c-0fea6e0b16c7 None admin] PATH_INFO: `/v3/projects/0499f6b6a46a4da2bb2ceedf8b6843b6` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:46.463464 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936a6ef3-436e-4c20-9a7c-0fea6e0b16c7 None admin] RBAC: Authorizing `identity:get_project(project_id=0499f6b6a46a4da2bb2ceedf8b6843b6)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:46.464916 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936a6ef3-436e-4c20-9a7c-0fea6e0b16c7 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:46.466674 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 63/130] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 25 11:51:46 2022] GET /identity/v3/projects/0499f6b6a46a4da2bb2ceedf8b6843b6 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:46.467436 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a6ef3-436e-4c20-9a7c-0fea6e0b16c7 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:46.515734 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc38cce-737a-4700-a8d1-c5de10fdd4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:46.516644 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc38cce-737a-4700-a8d1-c5de10fdd4d8 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:46.516927 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc38cce-737a-4700-a8d1-c5de10fdd4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:46.517204 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc38cce-737a-4700-a8d1-c5de10fdd4d8 None admin] PATH_INFO: `/v3/users/d56e0746442f4c68951b0eae41c997d3` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:46.521438 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc38cce-737a-4700-a8d1-c5de10fdd4d8 None admin] RBAC: Authorizing `identity:get_user(user_id=d56e0746442f4c68951b0eae41c997d3)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:46.522903 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc38cce-737a-4700-a8d1-c5de10fdd4d8 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:46.526094 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 68/131] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 25 11:51:46 2022] GET /identity/v3/users/d56e0746442f4c68951b0eae41c997d3 => generated 275 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:46.526846 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc38cce-737a-4700-a8d1-c5de10fdd4d8 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:46.580205 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:46.614814 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a6ef3-436e-4c20-9a7c-0fea6e0b16c7 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:46.653101 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682cf8a5-586a-4089-8298-a94883ecfe3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:46.654108 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682cf8a5-586a-4089-8298-a94883ecfe3f None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:46.654410 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682cf8a5-586a-4089-8298-a94883ecfe3f None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:46.654701 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682cf8a5-586a-4089-8298-a94883ecfe3f None admin] PATH_INFO: `/v3/users/d56e0746442f4c68951b0eae41c997d3` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:46.659053 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682cf8a5-586a-4089-8298-a94883ecfe3f None admin] RBAC: Authorizing `identity:get_user(user_id=d56e0746442f4c68951b0eae41c997d3)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:46.661558 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682cf8a5-586a-4089-8298-a94883ecfe3f None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:46.663222 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 64/132] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 25 11:51:46 2022] GET /identity/v3/users/d56e0746442f4c68951b0eae41c997d3 => generated 275 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:46.664118 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682cf8a5-586a-4089-8298-a94883ecfe3f None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:46.716788 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc38cce-737a-4700-a8d1-c5de10fdd4d8 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:46.755243 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989dd6ea-3db6-4760-8419-5879cfea0863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:46.756325 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989dd6ea-3db6-4760-8419-5879cfea0863 None admin] REQUEST_METHOD: `PUT` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:46.756673 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989dd6ea-3db6-4760-8419-5879cfea0863 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:46.756958 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989dd6ea-3db6-4760-8419-5879cfea0863 None admin] PATH_INFO: `/v3/projects/0499f6b6a46a4da2bb2ceedf8b6843b6/users/d56e0746442f4c68951b0eae41c997d3/roles/0bb7b8a3ae8f4d03a7f575ca8904963c` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:46.759216 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989dd6ea-3db6-4760-8419-5879cfea0863 None admin] RBAC: Authorizing `identity:create_grant(project_id=0499f6b6a46a4da2bb2ceedf8b6843b6, user_id=d56e0746442f4c68951b0eae41c997d3, role_id=0bb7b8a3ae8f4d03a7f575ca8904963c)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:46.767731 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989dd6ea-3db6-4760-8419-5879cfea0863 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:46.789741 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 69/133] 10.222.0.44 () {58 vars in 1439 bytes} [Wed May 25 11:51:46 2022] PUT /identity/v3/projects/0499f6b6a46a4da2bb2ceedf8b6843b6/users/d56e0746442f4c68951b0eae41c997d3/roles/0bb7b8a3ae8f4d03a7f575ca8904963c => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 11:51:46.797626 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989dd6ea-3db6-4760-8419-5879cfea0863 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:46.852381 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:47.002300 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682cf8a5-586a-4089-8298-a94883ecfe3f None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:47.002486 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989dd6ea-3db6-4760-8419-5879cfea0863 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:47.065016 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6647b7-a91b-4e10-8640-ef1539eaf853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:47.066289 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6647b7-a91b-4e10-8640-ef1539eaf853 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:47.066775 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6647b7-a91b-4e10-8640-ef1539eaf853 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:47.067304 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6647b7-a91b-4e10-8640-ef1539eaf853 None admin] PATH_INFO: `/v3/projects/0499f6b6a46a4da2bb2ceedf8b6843b6` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:47.068153 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:47.068851 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6647b7-a91b-4e10-8640-ef1539eaf853 None admin] RBAC: Authorizing `identity:get_project(project_id=0499f6b6a46a4da2bb2ceedf8b6843b6)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:47.070460 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6647b7-a91b-4e10-8640-ef1539eaf853 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:47.072451 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 70/134] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 25 11:51:46 2022] GET /identity/v3/projects/0499f6b6a46a4da2bb2ceedf8b6843b6 => generated 298 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:47.079902 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6647b7-a91b-4e10-8640-ef1539eaf853 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:47.113696 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad96549a-94fc-42da-9089-b7dda0eb2450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:47.114592 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad96549a-94fc-42da-9089-b7dda0eb2450 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:47.114884 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad96549a-94fc-42da-9089-b7dda0eb2450 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:47.115172 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad96549a-94fc-42da-9089-b7dda0eb2450 None admin] PATH_INFO: `/v3/projects/77abaefbc4da43f484b31efb185532a8` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:47.120732 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad96549a-94fc-42da-9089-b7dda0eb2450 None admin] RBAC: Authorizing `identity:get_project(project_id=77abaefbc4da43f484b31efb185532a8)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:47.122312 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad96549a-94fc-42da-9089-b7dda0eb2450 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:47.124196 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 65/135] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 25 11:51:46 2022] GET /identity/v3/projects/77abaefbc4da43f484b31efb185532a8 => generated 312 bytes in 460 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:47.130302 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad96549a-94fc-42da-9089-b7dda0eb2450 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:47.218549 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:47.228767 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6647b7-a91b-4e10-8640-ef1539eaf853 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:47.265532 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c19ffe-2555-4ade-bd37-80b481d76091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:47.266457 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c19ffe-2555-4ade-bd37-80b481d76091 None admin] REQUEST_METHOD: `PUT` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:47.266746 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c19ffe-2555-4ade-bd37-80b481d76091 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:47.267233 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c19ffe-2555-4ade-bd37-80b481d76091 None admin] PATH_INFO: `/v3/projects/0499f6b6a46a4da2bb2ceedf8b6843b6/users/d56e0746442f4c68951b0eae41c997d3/roles/1d75537a128747f180972029d0241cb4` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:47.269540 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c19ffe-2555-4ade-bd37-80b481d76091 None admin] RBAC: Authorizing `identity:create_grant(project_id=0499f6b6a46a4da2bb2ceedf8b6843b6, user_id=d56e0746442f4c68951b0eae41c997d3, role_id=1d75537a128747f180972029d0241cb4)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:47.271036 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c19ffe-2555-4ade-bd37-80b481d76091 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:47.288000 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 71/136] 10.222.0.44 () {58 vars in 1439 bytes} [Wed May 25 11:51:47 2022] PUT /identity/v3/projects/0499f6b6a46a4da2bb2ceedf8b6843b6/users/d56e0746442f4c68951b0eae41c997d3/roles/1d75537a128747f180972029d0241cb4 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 11:51:47.289419 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33e5e7-4db2-484e-8ce2-5d0610a577ee None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:47.291208 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33e5e7-4db2-484e-8ce2-5d0610a577ee None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:47.291208 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33e5e7-4db2-484e-8ce2-5d0610a577ee None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:47.291760 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 72/137] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:51:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:51:47.299291 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a674d-b11c-48fd-92bd-e662ad1e8d94 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:47.299590 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a674d-b11c-48fd-92bd-e662ad1e8d94 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:47.299854 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a674d-b11c-48fd-92bd-e662ad1e8d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:47.302839 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad96549a-94fc-42da-9089-b7dda0eb2450 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:47.327039 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-369a674d-b11c-48fd-92bd-e662ad1e8d94 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:51:47.328267 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-369a674d-b11c-48fd-92bd-e662ad1e8d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:51:47.413887 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31444e26-3828-4d9a-b96c-c63560e48333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:47.414810 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31444e26-3828-4d9a-b96c-c63560e48333 None admin] REQUEST_METHOD: `PUT` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:47.415083 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31444e26-3828-4d9a-b96c-c63560e48333 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:47.415363 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31444e26-3828-4d9a-b96c-c63560e48333 None admin] PATH_INFO: `/v3/projects/77abaefbc4da43f484b31efb185532a8/users/d56e0746442f4c68951b0eae41c997d3/roles/0bb7b8a3ae8f4d03a7f575ca8904963c` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:47.421331 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31444e26-3828-4d9a-b96c-c63560e48333 None admin] RBAC: Authorizing `identity:create_grant(project_id=77abaefbc4da43f484b31efb185532a8, user_id=d56e0746442f4c68951b0eae41c997d3, role_id=0bb7b8a3ae8f4d03a7f575ca8904963c)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:47.422825 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31444e26-3828-4d9a-b96c-c63560e48333 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:47.439776 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 73/138] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:51:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 11:51:47.440894 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 66/139] 10.222.0.44 () {58 vars in 1439 bytes} [Wed May 25 11:51:47 2022] PUT /identity/v3/projects/77abaefbc4da43f484b31efb185532a8/users/d56e0746442f4c68951b0eae41c997d3/roles/0bb7b8a3ae8f4d03a7f575ca8904963c => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 11:51:47.479745 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369a674d-b11c-48fd-92bd-e662ad1e8d94 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:47.592282 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:47.626235 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369a674d-b11c-48fd-92bd-e662ad1e8d94 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:47.675159 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a79d2b-6d8e-4f1c-9712-e254a248105f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:47.676030 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a79d2b-6d8e-4f1c-9712-e254a248105f None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:47.676321 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a79d2b-6d8e-4f1c-9712-e254a248105f None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:47.676606 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a79d2b-6d8e-4f1c-9712-e254a248105f None admin] PATH_INFO: `/v3/domains/default` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:47.680700 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a79d2b-6d8e-4f1c-9712-e254a248105f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:47.682144 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a79d2b-6d8e-4f1c-9712-e254a248105f None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:47.683924 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 74/140] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:51:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:47.689682 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31444e26-3828-4d9a-b96c-c63560e48333 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:47.784137 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:47.837800 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31444e26-3828-4d9a-b96c-c63560e48333 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:47.873623 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd04ef8-de2e-4706-98f6-50e582bdc016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:47.874224 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd04ef8-de2e-4706-98f6-50e582bdc016 None admin] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:47.874510 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd04ef8-de2e-4706-98f6-50e582bdc016 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:47.874793 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd04ef8-de2e-4706-98f6-50e582bdc016 None admin] PATH_INFO: `/v3/users` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:47.875511 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd04ef8-de2e-4706-98f6-50e582bdc016 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:47.877003 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd04ef8-de2e-4706-98f6-50e582bdc016 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:47.918249 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83de4e-5b8e-4b84-b4c6-4aae832e4edf None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:47.918700 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83de4e-5b8e-4b84-b4c6-4aae832e4edf None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:47.919102 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f83de4e-5b8e-4b84-b4c6-4aae832e4edf None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:47.920619 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 75/141] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:51:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:51:47.926989 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 67/142] 10.222.0.44 () {60 vars in 1132 bytes} [Wed May 25 11:51:47 2022] POST /identity/v3/users => generated 283 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 11:51:47.927523 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c2d63-afcd-46d3-904c-5df0433321e9 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:47.927523 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c2d63-afcd-46d3-904c-5df0433321e9 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:47.928003 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c2d63-afcd-46d3-904c-5df0433321e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:47.965015 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-a02c2d63-afcd-46d3-904c-5df0433321e9 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:51:47.966710 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-a02c2d63-afcd-46d3-904c-5df0433321e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:51:48.060665 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 76/143] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:51:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 11:51:48.110711 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd04ef8-de2e-4706-98f6-50e582bdc016 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:48.252892 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd04ef8-de2e-4706-98f6-50e582bdc016 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:48.267415 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:48.304118 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b6cb2-21da-411c-8a53-f572444167bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:48.305187 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b6cb2-21da-411c-8a53-f572444167bc None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:48.305614 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b6cb2-21da-411c-8a53-f572444167bc None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:48.306094 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b6cb2-21da-411c-8a53-f572444167bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:48.322280 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532b6cb2-21da-411c-8a53-f572444167bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:51:48.330723 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-532b6cb2-21da-411c-8a53-f572444167bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 11:51:48.330723 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:51:48.330723 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:51:48.330723 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:51:48.330723 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:51:48.330723 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:51:48.330723 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:51:48.330723 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:51:48.330723 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:51:48.330723 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:51:48.330723 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:51:48.330723 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:51:48.330723 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:51:48.330723 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:51:48.330723 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:51:48.330723 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:51:48.331825 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:51:48.331825 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:51:48.331825 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:51:48.331825 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:51:48.331825 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:51:48.331825 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:51:48.331825 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:51:48.331825 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:51:48.331825 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:51:48.331825 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:51:48.331825 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:51:48.331825 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:51:48.331825 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:51:48.331825 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:51:48.331825 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:51:48.331825 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:51:48.332759 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:51:48.332759 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:51:48.332759 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:51:48.332759 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:51:48.332759 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:51:48.332759 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:51:48.332759 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:51:48.332759 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:51:48.332759 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:51:48.332759 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:51:48.332759 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 11:51:48.332759 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:51:48.334708 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 68/144] 10.222.0.44 () {56 vars in 1096 bytes} [Wed May 25 11:51:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:51:48.341360 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02c2d63-afcd-46d3-904c-5df0433321e9 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:48.441307 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:48.462921 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02c2d63-afcd-46d3-904c-5df0433321e9 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:48.501369 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09332b4c-5670-4cfe-ae0e-76e1e33565e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:48.502044 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09332b4c-5670-4cfe-ae0e-76e1e33565e7 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:48.502330 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09332b4c-5670-4cfe-ae0e-76e1e33565e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:48.502608 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09332b4c-5670-4cfe-ae0e-76e1e33565e7 None admin] PATH_INFO: `/v3/roles` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:48.503364 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09332b4c-5670-4cfe-ae0e-76e1e33565e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:51:48.503674 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09332b4c-5670-4cfe-ae0e-76e1e33565e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:48.505130 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09332b4c-5670-4cfe-ae0e-76e1e33565e7 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:48.514383 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 77/145] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 25 11:51:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:48.520106 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b6cb2-21da-411c-8a53-f572444167bc None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:48.630723 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b6cb2-21da-411c-8a53-f572444167bc None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:48.668259 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7be346-2be8-4f3e-8f16-d5aea2ac7bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:48.669184 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7be346-2be8-4f3e-8f16-d5aea2ac7bba None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:48.669475 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7be346-2be8-4f3e-8f16-d5aea2ac7bba None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:48.669758 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7be346-2be8-4f3e-8f16-d5aea2ac7bba None admin] PATH_INFO: `/v3/users/c3f509c203864ee381a0b9ac7112de28` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:48.670981 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7be346-2be8-4f3e-8f16-d5aea2ac7bba None admin] RBAC: Authorizing `identity:get_user(user_id=c3f509c203864ee381a0b9ac7112de28)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:48.672490 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7be346-2be8-4f3e-8f16-d5aea2ac7bba None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:48.674354 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 69/146] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 25 11:51:48 2022] GET /identity/v3/users/c3f509c203864ee381a0b9ac7112de28 => generated 247 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:48.679868 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09332b4c-5670-4cfe-ae0e-76e1e33565e7 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:48.794597 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09332b4c-5670-4cfe-ae0e-76e1e33565e7 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:48.838880 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ce62c-bdbc-4960-b7b4-0f73473bbff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:48.839951 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ce62c-bdbc-4960-b7b4-0f73473bbff8 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:48.840465 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ce62c-bdbc-4960-b7b4-0f73473bbff8 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:48.840944 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ce62c-bdbc-4960-b7b4-0f73473bbff8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:48.854710 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:48.923484 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ce62c-bdbc-4960-b7b4-0f73473bbff8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:48.925292 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ce62c-bdbc-4960-b7b4-0f73473bbff8 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:49.025381 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 78/147] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 25 11:51:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 11:51:49.034131 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7be346-2be8-4f3e-8f16-d5aea2ac7bba None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:49.097753 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:49.153339 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea5c00c-db36-4cb3-a731-fa8839fb477f None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:49.153782 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea5c00c-db36-4cb3-a731-fa8839fb477f None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:49.154159 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea5c00c-db36-4cb3-a731-fa8839fb477f None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:49.155635 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 79/148] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:51:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:51:49.161100 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4b5e3-ee10-4f32-8eaa-31aea0aa8fc9 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:49.161387 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4b5e3-ee10-4f32-8eaa-31aea0aa8fc9 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:49.161665 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4b5e3-ee10-4f32-8eaa-31aea0aa8fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:49.172862 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7be346-2be8-4f3e-8f16-d5aea2ac7bba None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:49.194545 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-f2b4b5e3-ee10-4f32-8eaa-31aea0aa8fc9 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:51:49.195737 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-f2b4b5e3-ee10-4f32-8eaa-31aea0aa8fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:51:49.245214 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:49.248698 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b853bb-dab7-4eea-ba74-19becf7b4d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:49.249626 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b853bb-dab7-4eea-ba74-19becf7b4d61 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:49.249911 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b853bb-dab7-4eea-ba74-19becf7b4d61 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:49.250187 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b853bb-dab7-4eea-ba74-19becf7b4d61 None admin] PATH_INFO: `/v3/projects/0499f6b6a46a4da2bb2ceedf8b6843b6` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:49.251651 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b853bb-dab7-4eea-ba74-19becf7b4d61 None admin] RBAC: Authorizing `identity:get_project(project_id=0499f6b6a46a4da2bb2ceedf8b6843b6)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:49.253242 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b853bb-dab7-4eea-ba74-19becf7b4d61 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:49.255147 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 70/149] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 25 11:51:49 2022] GET /identity/v3/projects/0499f6b6a46a4da2bb2ceedf8b6843b6 => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:49.261200 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b853bb-dab7-4eea-ba74-19becf7b4d61 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:49.313464 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 80/150] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:51:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 25 11:51:49.340831 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b4b5e3-ee10-4f32-8eaa-31aea0aa8fc9 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:49.489708 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b4b5e3-ee10-4f32-8eaa-31aea0aa8fc9 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:49.490542 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b853bb-dab7-4eea-ba74-19becf7b4d61 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:49.496813 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:49.542735 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690dbdbe-848b-4ad5-9da9-8cbdd0a7f97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:49.544199 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690dbdbe-848b-4ad5-9da9-8cbdd0a7f97f None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:49.544484 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690dbdbe-848b-4ad5-9da9-8cbdd0a7f97f None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:49.544759 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690dbdbe-848b-4ad5-9da9-8cbdd0a7f97f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:49.559983 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690dbdbe-848b-4ad5-9da9-8cbdd0a7f97f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:51:49.560485 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7fa66-5c07-411c-ae2a-9fd080253430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:49.561157 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7fa66-5c07-411c-ae2a-9fd080253430 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:49.561441 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7fa66-5c07-411c-ae2a-9fd080253430 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:49.561720 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7fa66-5c07-411c-ae2a-9fd080253430 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:49.562557 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7fa66-5c07-411c-ae2a-9fd080253430 None admin] RBAC: Adding query filter params (role.id=2fe5c1214bcc4c1bafa5a4545161518d, scope.project.id=0499f6b6a46a4da2bb2ceedf8b6843b6, user.id=c3f509c203864ee381a0b9ac7112de28) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:51:49.562869 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7fa66-5c07-411c-ae2a-9fd080253430 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:49.564355 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7fa66-5c07-411c-ae2a-9fd080253430 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:49.573567 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-690dbdbe-848b-4ad5-9da9-8cbdd0a7f97f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 11:51:49.573567 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:51:49.573567 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:51:49.573567 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:51:49.573567 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:51:49.573567 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:51:49.573567 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:51:49.573567 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:51:49.573567 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:51:49.573567 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:51:49.573567 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:51:49.573567 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:51:49.573567 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:51:49.573567 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:51:49.573567 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:51:49.573567 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:51:49.574770 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:51:49.574770 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:51:49.574770 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:51:49.574770 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:51:49.574770 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:51:49.574770 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:51:49.574770 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:51:49.574770 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:51:49.574770 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:51:49.574770 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:51:49.574770 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:51:49.574770 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:51:49.574770 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:51:49.574770 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:51:49.574770 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:51:49.574770 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:51:49.576376 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:51:49.576376 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:51:49.576376 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:51:49.576376 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:51:49.576376 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:51:49.576376 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:51:49.576376 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:51:49.576376 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:51:49.576376 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:51:49.576376 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:51:49.576376 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 11:51:49.576376 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:51:49.576989 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 71/151] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 25 11:51:49 2022] GET /identity/v3/role_assignments?user.id=c3f509c203864ee381a0b9ac7112de28&scope.project.id=0499f6b6a46a4da2bb2ceedf8b6843b6&role.id=2fe5c1214bcc4c1bafa5a4545161518d => generated 608 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:51:49.577275 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 81/152] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 25 11:51:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 11:51:49.584977 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7fa66-5c07-411c-ae2a-9fd080253430 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:49.727673 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7fa66-5c07-411c-ae2a-9fd080253430 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:49.770359 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdad3f4-b7ca-43eb-8832-4063f236ff60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:49.770976 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdad3f4-b7ca-43eb-8832-4063f236ff60 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:49.771263 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdad3f4-b7ca-43eb-8832-4063f236ff60 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:49.771543 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdad3f4-b7ca-43eb-8832-4063f236ff60 None admin] PATH_INFO: `/v3/roles` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:49.772341 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdad3f4-b7ca-43eb-8832-4063f236ff60 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:51:49.772654 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdad3f4-b7ca-43eb-8832-4063f236ff60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:49.774334 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdad3f4-b7ca-43eb-8832-4063f236ff60 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:49.787947 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 72/153] 10.222.0.44 () {56 vars in 1101 bytes} [Wed May 25 11:51:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:49.797875 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690dbdbe-848b-4ad5-9da9-8cbdd0a7f97f None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:49.856239 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:49.938050 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690dbdbe-848b-4ad5-9da9-8cbdd0a7f97f None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:49.982938 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd74c8e3-dc4f-4e3e-9fce-c15119a409e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:49.983922 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74c8e3-dc4f-4e3e-9fce-c15119a409e4 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:49.984209 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74c8e3-dc4f-4e3e-9fce-c15119a409e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:49.984486 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74c8e3-dc4f-4e3e-9fce-c15119a409e4 None admin] PATH_INFO: `/v3/users/194c46c6242d45c5b38351e3eb7ebd3a` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:49.985721 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd74c8e3-dc4f-4e3e-9fce-c15119a409e4 None admin] RBAC: Authorizing `identity:get_user(user_id=194c46c6242d45c5b38351e3eb7ebd3a)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:49.987175 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd74c8e3-dc4f-4e3e-9fce-c15119a409e4 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:49.988828 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 82/154] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 25 11:51:49 2022] GET /identity/v3/users/194c46c6242d45c5b38351e3eb7ebd3a => generated 289 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:49.994310 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdad3f4-b7ca-43eb-8832-4063f236ff60 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:50.047710 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:50.150781 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdad3f4-b7ca-43eb-8832-4063f236ff60 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:50.193883 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44274d07-815c-4306-81db-941de66a8084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:50.194773 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44274d07-815c-4306-81db-941de66a8084 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:50.195058 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44274d07-815c-4306-81db-941de66a8084 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:50.195336 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44274d07-815c-4306-81db-941de66a8084 None admin] PATH_INFO: `/v3/projects/0499f6b6a46a4da2bb2ceedf8b6843b6` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:50.196584 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44274d07-815c-4306-81db-941de66a8084 None admin] RBAC: Authorizing `identity:get_project(project_id=0499f6b6a46a4da2bb2ceedf8b6843b6)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:50.198056 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44274d07-815c-4306-81db-941de66a8084 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:50.204397 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 73/155] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 25 11:51:49 2022] GET /identity/v3/projects/0499f6b6a46a4da2bb2ceedf8b6843b6 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:50.210191 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd74c8e3-dc4f-4e3e-9fce-c15119a409e4 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:50.352902 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:50.355710 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd74c8e3-dc4f-4e3e-9fce-c15119a409e4 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:50.401353 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b64deb-e469-4bc5-b9fb-9488bc8be573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:50.402248 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b64deb-e469-4bc5-b9fb-9488bc8be573 None admin] REQUEST_METHOD: `PUT` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:50.402532 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b64deb-e469-4bc5-b9fb-9488bc8be573 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:50.403330 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b64deb-e469-4bc5-b9fb-9488bc8be573 None admin] PATH_INFO: `/v3/projects/0499f6b6a46a4da2bb2ceedf8b6843b6/users/194c46c6242d45c5b38351e3eb7ebd3a/roles/038496e26bf34707a6fa4de9bc368de5` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:50.412758 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b64deb-e469-4bc5-b9fb-9488bc8be573 None admin] RBAC: Authorizing `identity:create_grant(project_id=0499f6b6a46a4da2bb2ceedf8b6843b6, user_id=194c46c6242d45c5b38351e3eb7ebd3a, role_id=038496e26bf34707a6fa4de9bc368de5)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:50.414271 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b64deb-e469-4bc5-b9fb-9488bc8be573 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:50.431432 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 83/156] 10.222.0.44 () {58 vars in 1439 bytes} [Wed May 25 11:51:50 2022] PUT /identity/v3/projects/0499f6b6a46a4da2bb2ceedf8b6843b6/users/194c46c6242d45c5b38351e3eb7ebd3a/roles/038496e26bf34707a6fa4de9bc368de5 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 11:51:50.697220 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81252b6a-d5c7-4076-b9a7-3a83b3c24425 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:50.697772 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81252b6a-d5c7-4076-b9a7-3a83b3c24425 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:50.697772 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81252b6a-d5c7-4076-b9a7-3a83b3c24425 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:50.699434 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 74/157] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:51:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:51:50.710054 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38cc15f-858e-4b62-933b-07347204df8e None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:50.710572 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38cc15f-858e-4b62-933b-07347204df8e None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:50.710647 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38cc15f-858e-4b62-933b-07347204df8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:50.732727 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-b38cc15f-858e-4b62-933b-07347204df8e None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:51:50.733950 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-b38cc15f-858e-4b62-933b-07347204df8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:51:50.821080 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 84/158] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:51:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 11:51:50.875119 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81252b6a-d5c7-4076-b9a7-3a83b3c24425 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:51.000099 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:51.006410 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81252b6a-d5c7-4076-b9a7-3a83b3c24425 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:51.052659 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32dfda-6361-482f-a4e6-92064ac58459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:51.053462 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32dfda-6361-482f-a4e6-92064ac58459 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:51.053839 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32dfda-6361-482f-a4e6-92064ac58459 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:51.054020 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32dfda-6361-482f-a4e6-92064ac58459 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:51.071293 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e32dfda-6361-482f-a4e6-92064ac58459 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:51:51.079897 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-4e32dfda-6361-482f-a4e6-92064ac58459 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 11:51:51.079897 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:51:51.079897 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:51:51.079897 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:51:51.079897 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:51:51.079897 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:51:51.079897 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:51:51.079897 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:51:51.079897 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:51:51.079897 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:51:51.079897 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:51:51.079897 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:51:51.079897 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:51:51.079897 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:51:51.079897 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:51:51.079897 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:51:51.080845 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:51:51.080845 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:51:51.080845 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:51:51.080845 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:51:51.080845 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:51:51.080845 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:51:51.080845 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:51:51.080845 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:51:51.080845 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:51:51.080845 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:51:51.080845 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:51:51.080845 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:51:51.080845 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:51:51.080845 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:51:51.080845 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:51:51.080845 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:51:51.082108 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:51:51.082108 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:51:51.082108 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:51:51.082108 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:51:51.082108 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:51:51.082108 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:51:51.082108 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:51:51.082108 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:51:51.082108 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:51:51.082108 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:51:51.082108 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 11:51:51.082108 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:51:51.082108 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 75/159] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 25 11:51:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:51:51.086957 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38cc15f-858e-4b62-933b-07347204df8e None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:51.260236 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:51.275779 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38cc15f-858e-4b62-933b-07347204df8e None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:51.331058 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3557ce38-2d5d-4280-848e-00b7f036db27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:51.331742 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557ce38-2d5d-4280-848e-00b7f036db27 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:51.332050 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557ce38-2d5d-4280-848e-00b7f036db27 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:51.332323 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557ce38-2d5d-4280-848e-00b7f036db27 None admin] PATH_INFO: `/v3/roles` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:51.333079 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3557ce38-2d5d-4280-848e-00b7f036db27 None admin] RBAC: Adding query filter params (name=member) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:51:51.333383 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3557ce38-2d5d-4280-848e-00b7f036db27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:51.334755 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3557ce38-2d5d-4280-848e-00b7f036db27 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:51.344501 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 85/160] 10.222.0.44 () {56 vars in 1101 bytes} [Wed May 25 11:51:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:51.352960 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32dfda-6361-482f-a4e6-92064ac58459 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:51.460892 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab63e62-5dba-4227-922d-4808306bd5e9 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:51.461232 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab63e62-5dba-4227-922d-4808306bd5e9 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:51.461452 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab63e62-5dba-4227-922d-4808306bd5e9 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:51.463038 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 86/161] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:51:51.469713 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78398f0-ce43-42b2-a486-e85683e4b3f4 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:51.469999 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78398f0-ce43-42b2-a486-e85683e4b3f4 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:51.470275 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78398f0-ce43-42b2-a486-e85683e4b3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:51.493110 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-a78398f0-ce43-42b2-a486-e85683e4b3f4 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:51:51.494297 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-a78398f0-ce43-42b2-a486-e85683e4b3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:51:51.531395 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32dfda-6361-482f-a4e6-92064ac58459 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:51.579511 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2568e7-4938-4438-8cfa-ac6b31adad52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:51.580415 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2568e7-4938-4438-8cfa-ac6b31adad52 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:51.580700 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2568e7-4938-4438-8cfa-ac6b31adad52 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:51.580978 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2568e7-4938-4438-8cfa-ac6b31adad52 None admin] PATH_INFO: `/v3/users/d56e0746442f4c68951b0eae41c997d3` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:51.584878 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2568e7-4938-4438-8cfa-ac6b31adad52 None admin] RBAC: Authorizing `identity:get_user(user_id=d56e0746442f4c68951b0eae41c997d3)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:51.586362 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2568e7-4938-4438-8cfa-ac6b31adad52 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:51.587991 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 76/162] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 25 11:51:51 2022] GET /identity/v3/users/d56e0746442f4c68951b0eae41c997d3 => generated 275 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:51.595637 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a064905-ae24-4848-b96e-75ed8fe123aa None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:51.595973 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a064905-ae24-4848-b96e-75ed8fe123aa None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:51.596254 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a064905-ae24-4848-b96e-75ed8fe123aa None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:51.597539 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 77/163] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:51:51 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:51:51.598250 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a064905-ae24-4848-b96e-75ed8fe123aa None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:51.636900 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 87/164] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:51:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 11:51:51.638711 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0329624-e1e0-4bd8-83d8-56bdeab16367 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:51.638996 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0329624-e1e0-4bd8-83d8-56bdeab16367 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:51.639271 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0329624-e1e0-4bd8-83d8-56bdeab16367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:51.661541 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:51.667814 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-e0329624-e1e0-4bd8-83d8-56bdeab16367 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:51:51.669047 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-e0329624-e1e0-4bd8-83d8-56bdeab16367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:51:51.791451 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 88/165] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:51:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 11:51:51.792334 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0329624-e1e0-4bd8-83d8-56bdeab16367 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:51.828166 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:51.843219 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a064905-ae24-4848-b96e-75ed8fe123aa None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:51.900928 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace3ad28-695d-4782-9a6e-3f0c046509f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:51.901593 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3ad28-695d-4782-9a6e-3f0c046509f7 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:51.901933 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3ad28-695d-4782-9a6e-3f0c046509f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:51.902209 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3ad28-695d-4782-9a6e-3f0c046509f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:51.925588 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0329624-e1e0-4bd8-83d8-56bdeab16367 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:51.960750 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50494c8-7438-4fc3-8d6b-1f688b7c3d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:51.961551 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50494c8-7438-4fc3-8d6b-1f688b7c3d65 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:51.961833 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50494c8-7438-4fc3-8d6b-1f688b7c3d65 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:51.962109 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50494c8-7438-4fc3-8d6b-1f688b7c3d65 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:51.973479 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50494c8-7438-4fc3-8d6b-1f688b7c3d65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:51:51.984480 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-c50494c8-7438-4fc3-8d6b-1f688b7c3d65 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 11:51:51.984480 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:51:51.984480 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:51:51.984480 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:51:51.984480 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:51:51.984480 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:51:51.984480 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:51:51.984480 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:51:51.984480 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:51:51.984480 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:51:51.984480 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:51:51.984480 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:51:51.984480 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:51:51.984480 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:51:51.984480 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:51:51.984480 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:51:51.985370 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:51:51.985370 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:51:51.985370 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:51:51.985370 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:51:51.985370 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:51:51.985370 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:51:51.985370 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:51:51.985370 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:51:51.985370 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:51:51.985370 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:51:51.985370 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:51:51.985370 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:51:51.985370 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:51:51.985370 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:51:51.985370 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:51:51.985370 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:51:51.986364 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:51:51.986364 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:51:51.986364 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:51:51.986364 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:51:51.986364 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:51:51.986364 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:51:51.986364 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:51:51.986364 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:51:51.986364 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:51:51.986364 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:51:51.986364 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 11:51:51.986364 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:51:51.986364 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 89/166] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 25 11:51:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:51:51.987017 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50494c8-7438-4fc3-8d6b-1f688b7c3d65 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:52.019917 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace3ad28-695d-4782-9a6e-3f0c046509f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:52.021440 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace3ad28-695d-4782-9a6e-3f0c046509f7 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:52.071257 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:52.120500 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:52.183420 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50494c8-7438-4fc3-8d6b-1f688b7c3d65 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:52.226572 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 78/167] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 25 11:51:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 628 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 11:51:52.227463 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace3ad28-695d-4782-9a6e-3f0c046509f7 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:52.276357 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d31ebc-45fa-4e7a-9008-8bb3351afcca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:52.277610 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d31ebc-45fa-4e7a-9008-8bb3351afcca None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:52.278542 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d31ebc-45fa-4e7a-9008-8bb3351afcca None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:52.278959 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d31ebc-45fa-4e7a-9008-8bb3351afcca None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:52.299107 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d31ebc-45fa-4e7a-9008-8bb3351afcca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:51:52.307265 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-52d31ebc-45fa-4e7a-9008-8bb3351afcca None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 11:51:52.307265 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:51:52.307265 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:51:52.307265 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:51:52.307265 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:51:52.307265 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:51:52.307265 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:51:52.307265 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:51:52.307265 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:51:52.307265 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:51:52.307265 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:51:52.307265 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:51:52.307265 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:51:52.307265 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:51:52.307265 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:51:52.307265 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:51:52.308168 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:51:52.308168 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:51:52.308168 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:51:52.308168 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:51:52.308168 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:51:52.308168 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:51:52.308168 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:51:52.308168 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:51:52.308168 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:51:52.308168 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:51:52.308168 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:51:52.308168 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:51:52.308168 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:51:52.308168 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:51:52.308168 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:51:52.308168 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:51:52.308991 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:51:52.308991 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:51:52.308991 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:51:52.308991 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:51:52.308991 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:51:52.308991 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:51:52.308991 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:51:52.308991 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:51:52.308991 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:51:52.308991 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:51:52.308991 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 11:51:52.308991 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:51:52.308991 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 90/168] 10.222.0.44 () {56 vars in 1114 bytes} [Wed May 25 11:51:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:51:52.309639 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d31ebc-45fa-4e7a-9008-8bb3351afcca None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:52.423824 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace3ad28-695d-4782-9a6e-3f0c046509f7 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:52.451958 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:52.461209 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5afbc-1348-4e01-a674-be5ae4810514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:52.461887 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5afbc-1348-4e01-a674-be5ae4810514 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:52.462173 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5afbc-1348-4e01-a674-be5ae4810514 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:52.462454 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5afbc-1348-4e01-a674-be5ae4810514 None admin] PATH_INFO: `/v3/roles` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:52.463212 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e5afbc-1348-4e01-a674-be5ae4810514 None admin] RBAC: Adding query filter params (name=member) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:51:52.463943 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e5afbc-1348-4e01-a674-be5ae4810514 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:52.465068 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e5afbc-1348-4e01-a674-be5ae4810514 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:52.473708 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 79/169] 10.222.0.44 () {56 vars in 1101 bytes} [Wed May 25 11:51:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:52.474630 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5afbc-1348-4e01-a674-be5ae4810514 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:52.491279 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d31ebc-45fa-4e7a-9008-8bb3351afcca None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:52.544283 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:52.553667 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f9b309-6db2-477f-bd12-89b2cced7f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:52.554812 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f9b309-6db2-477f-bd12-89b2cced7f7a None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:52.555302 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f9b309-6db2-477f-bd12-89b2cced7f7a None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:52.555781 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f9b309-6db2-477f-bd12-89b2cced7f7a None admin] PATH_INFO: `/v3/projects/0499f6b6a46a4da2bb2ceedf8b6843b6` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:52.557339 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f9b309-6db2-477f-bd12-89b2cced7f7a None admin] RBAC: Authorizing `identity:get_project(project_id=0499f6b6a46a4da2bb2ceedf8b6843b6)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:52.559529 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f9b309-6db2-477f-bd12-89b2cced7f7a None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:52.561468 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 91/170] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 25 11:51:52 2022] GET /identity/v3/projects/0499f6b6a46a4da2bb2ceedf8b6843b6 => generated 298 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:52.562322 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f9b309-6db2-477f-bd12-89b2cced7f7a None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:52.605192 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5afbc-1348-4e01-a674-be5ae4810514 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:52.655264 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cb3eb4-e2aa-4f7b-b35f-117c5378359c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:52.656367 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb3eb4-e2aa-4f7b-b35f-117c5378359c None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:52.656891 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb3eb4-e2aa-4f7b-b35f-117c5378359c None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:52.657361 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb3eb4-e2aa-4f7b-b35f-117c5378359c None admin] PATH_INFO: `/v3/roles` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:52.658332 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cb3eb4-e2aa-4f7b-b35f-117c5378359c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:51:52.658855 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cb3eb4-e2aa-4f7b-b35f-117c5378359c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:52.661323 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cb3eb4-e2aa-4f7b-b35f-117c5378359c None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:52.671166 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 80/171] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 25 11:51:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:52.676375 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cb3eb4-e2aa-4f7b-b35f-117c5378359c None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:52.741077 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f9b309-6db2-477f-bd12-89b2cced7f7a None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:52.752791 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:52.783820 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23202593-69a9-402e-a790-605381333cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:52.783820 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23202593-69a9-402e-a790-605381333cf9 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:52.783820 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23202593-69a9-402e-a790-605381333cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:52.783820 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23202593-69a9-402e-a790-605381333cf9 None admin] PATH_INFO: `/v3/users/d56e0746442f4c68951b0eae41c997d3` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:52.784275 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23202593-69a9-402e-a790-605381333cf9 None admin] RBAC: Authorizing `identity:get_user(user_id=d56e0746442f4c68951b0eae41c997d3)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:52.784946 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23202593-69a9-402e-a790-605381333cf9 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:52.786854 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 92/172] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 25 11:51:52 2022] GET /identity/v3/users/d56e0746442f4c68951b0eae41c997d3 => generated 275 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:52.787544 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23202593-69a9-402e-a790-605381333cf9 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:52.837945 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cb3eb4-e2aa-4f7b-b35f-117c5378359c None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:52.906744 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36612c17-5597-4be9-803b-8c3c7a5ff890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:52.908104 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36612c17-5597-4be9-803b-8c3c7a5ff890 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:52.908799 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36612c17-5597-4be9-803b-8c3c7a5ff890 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:52.910548 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36612c17-5597-4be9-803b-8c3c7a5ff890 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:52.911543 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36612c17-5597-4be9-803b-8c3c7a5ff890 None admin] RBAC: Adding query filter params (role.id=0bb7b8a3ae8f4d03a7f575ca8904963c, scope.project.id=0499f6b6a46a4da2bb2ceedf8b6843b6, user.id=d56e0746442f4c68951b0eae41c997d3) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:51:52.913117 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36612c17-5597-4be9-803b-8c3c7a5ff890 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:52.914723 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36612c17-5597-4be9-803b-8c3c7a5ff890 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:52.931676 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:52.933032 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 81/173] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 25 11:51:52 2022] GET /identity/v3/role_assignments?user.id=d56e0746442f4c68951b0eae41c997d3&scope.project.id=0499f6b6a46a4da2bb2ceedf8b6843b6&role.id=0bb7b8a3ae8f4d03a7f575ca8904963c => generated 608 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:52.934261 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21273f6-7dba-42f0-bbc1-fb18cc531da3 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:52.934548 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21273f6-7dba-42f0-bbc1-fb18cc531da3 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:52.939824 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21273f6-7dba-42f0-bbc1-fb18cc531da3 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:52.939824 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 82/174] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:51:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:51:52.939824 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21273f6-7dba-42f0-bbc1-fb18cc531da3 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:52.993832 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23202593-69a9-402e-a790-605381333cf9 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:53.057266 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c44244-f257-4ad7-a580-816a4d06bda4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:53.058344 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c44244-f257-4ad7-a580-816a4d06bda4 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:53.058630 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c44244-f257-4ad7-a580-816a4d06bda4 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:53.058941 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c44244-f257-4ad7-a580-816a4d06bda4 None admin] PATH_INFO: `/v3/users/d56e0746442f4c68951b0eae41c997d3` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:53.060518 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c44244-f257-4ad7-a580-816a4d06bda4 None admin] RBAC: Authorizing `identity:get_user(user_id=d56e0746442f4c68951b0eae41c997d3)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:53.062414 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c44244-f257-4ad7-a580-816a4d06bda4 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:53.064471 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 93/175] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 25 11:51:52 2022] GET /identity/v3/users/d56e0746442f4c68951b0eae41c997d3 => generated 275 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:53.065853 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a909293-8f09-44bf-a632-8578771f6aca None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:53.066147 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a909293-8f09-44bf-a632-8578771f6aca None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:53.066426 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a909293-8f09-44bf-a632-8578771f6aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:53.074169 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21273f6-7dba-42f0-bbc1-fb18cc531da3 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:53.091288 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-9a909293-8f09-44bf-a632-8578771f6aca None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:51:53.092635 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-9a909293-8f09-44bf-a632-8578771f6aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:51:53.104266 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:53.152243 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ca7edc-ed69-4a18-a096-d899b9e63d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:53.153488 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca7edc-ed69-4a18-a096-d899b9e63d32 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:53.153783 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca7edc-ed69-4a18-a096-d899b9e63d32 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:53.154054 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca7edc-ed69-4a18-a096-d899b9e63d32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:53.189781 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 94/176] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:51:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 11:51:53.190763 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a909293-8f09-44bf-a632-8578771f6aca None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:53.313214 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ca7edc-ed69-4a18-a096-d899b9e63d32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:53.315940 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ca7edc-ed69-4a18-a096-d899b9e63d32 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:53.344402 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:53.445358 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a909293-8f09-44bf-a632-8578771f6aca None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:53.514869 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4235f6df-4330-405a-817a-37bce52d5ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:53.516025 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4235f6df-4330-405a-817a-37bce52d5ce6 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:53.516547 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4235f6df-4330-405a-817a-37bce52d5ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:53.517034 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4235f6df-4330-405a-817a-37bce52d5ce6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:53.528474 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 83/177] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 25 11:51:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 11:51:53.530581 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ca7edc-ed69-4a18-a096-d899b9e63d32 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:53.560513 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:53.632351 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4235f6df-4330-405a-817a-37bce52d5ce6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:53.634413 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4235f6df-4330-405a-817a-37bce52d5ce6 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:53.715036 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:53.744687 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ca7edc-ed69-4a18-a096-d899b9e63d32 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:53.759183 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 95/178] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 25 11:51:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 11:51:53.761562 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ef322-ef7c-4b06-9c6d-adbda4520a21 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:53.762615 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ef322-ef7c-4b06-9c6d-adbda4520a21 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:53.763105 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ef322-ef7c-4b06-9c6d-adbda4520a21 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:53.765489 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 96/179] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:51:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:51:53.769934 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90ef322-ef7c-4b06-9c6d-adbda4520a21 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:53.812323 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2757647e-c2a8-432a-9927-8d92b2dbfb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:53.813287 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757647e-c2a8-432a-9927-8d92b2dbfb50 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:53.813573 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757647e-c2a8-432a-9927-8d92b2dbfb50 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:53.813850 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757647e-c2a8-432a-9927-8d92b2dbfb50 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:53.829720 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2757647e-c2a8-432a-9927-8d92b2dbfb50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:51:53.837472 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-2757647e-c2a8-432a-9927-8d92b2dbfb50 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 11:51:53.837472 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:51:53.837472 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:51:53.837472 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:51:53.837472 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:51:53.837472 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:51:53.837472 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:51:53.837472 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:51:53.837472 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:51:53.837472 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:51:53.837472 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:51:53.837472 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:51:53.837472 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:51:53.837472 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:51:53.837472 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:51:53.837472 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:51:53.838340 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:51:53.838340 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:51:53.838340 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:51:53.838340 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:51:53.838340 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:51:53.838340 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:51:53.838340 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:51:53.838340 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:51:53.838340 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:51:53.838340 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:51:53.838340 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:51:53.838340 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:51:53.838340 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:51:53.838340 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:51:53.838340 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:51:53.838340 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:51:53.844615 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:51:53.844615 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:51:53.844615 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:51:53.844615 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:51:53.844615 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:51:53.844615 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:51:53.844615 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:51:53.844615 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:51:53.844615 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:51:53.844615 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:51:53.844615 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 11:51:53.844615 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:51:53.844615 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 84/180] 10.222.0.44 () {56 vars in 1096 bytes} [Wed May 25 11:51:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:51:53.844615 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2757647e-c2a8-432a-9927-8d92b2dbfb50 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:53.899219 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90ef322-ef7c-4b06-9c6d-adbda4520a21 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:53.919740 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:53.935122 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a772fa3c-0abe-432e-b3aa-17674ffb49a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:53.936019 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772fa3c-0abe-432e-b3aa-17674ffb49a2 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:53.936302 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772fa3c-0abe-432e-b3aa-17674ffb49a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:53.936575 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772fa3c-0abe-432e-b3aa-17674ffb49a2 None admin] PATH_INFO: `/v3/projects/77abaefbc4da43f484b31efb185532a8` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:53.937754 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a772fa3c-0abe-432e-b3aa-17674ffb49a2 None admin] RBAC: Authorizing `identity:get_project(project_id=77abaefbc4da43f484b31efb185532a8)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:53.939203 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a772fa3c-0abe-432e-b3aa-17674ffb49a2 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:53.940957 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 97/181] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 25 11:51:53 2022] GET /identity/v3/projects/77abaefbc4da43f484b31efb185532a8 => generated 312 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:53.942144 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b96de-6825-4e1d-9ada-bd1f1fdcbe86 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:53.942422 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b96de-6825-4e1d-9ada-bd1f1fdcbe86 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:53.942692 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b96de-6825-4e1d-9ada-bd1f1fdcbe86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:53.953162 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2757647e-c2a8-432a-9927-8d92b2dbfb50 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:53.960234 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-057b96de-6825-4e1d-9ada-bd1f1fdcbe86 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:51:53.961415 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-057b96de-6825-4e1d-9ada-bd1f1fdcbe86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:51:53.988800 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0a2c55-f0b9-4fa7-a787-85373d7d361c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:53.988973 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:53.989955 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a2c55-f0b9-4fa7-a787-85373d7d361c None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:53.990326 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a2c55-f0b9-4fa7-a787-85373d7d361c None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:53.990533 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a2c55-f0b9-4fa7-a787-85373d7d361c None admin] PATH_INFO: `/v3/projects/0499f6b6a46a4da2bb2ceedf8b6843b6` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:53.991730 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0a2c55-f0b9-4fa7-a787-85373d7d361c None admin] RBAC: Authorizing `identity:get_project(project_id=0499f6b6a46a4da2bb2ceedf8b6843b6)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:53.993217 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0a2c55-f0b9-4fa7-a787-85373d7d361c None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:53.994915 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 85/182] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 25 11:51:53 2022] GET /identity/v3/projects/0499f6b6a46a4da2bb2ceedf8b6843b6 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:53.996202 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28deeac7-912a-4e1e-b994-dabd6ed3d170 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:53.997067 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28deeac7-912a-4e1e-b994-dabd6ed3d170 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:53.997353 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28deeac7-912a-4e1e-b994-dabd6ed3d170 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:53.998704 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 86/183] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:51:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:51:53.999254 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28deeac7-912a-4e1e-b994-dabd6ed3d170 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:54.042107 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 98/184] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:51:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 11:51:54.052060 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b96de-6825-4e1d-9ada-bd1f1fdcbe86 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:54.124932 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28deeac7-912a-4e1e-b994-dabd6ed3d170 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:54.151572 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b96de-6825-4e1d-9ada-bd1f1fdcbe86 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:54.160360 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef098c9a-f26b-432b-b8ea-9683f05952d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:54.161038 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef098c9a-f26b-432b-b8ea-9683f05952d1 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:54.161324 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef098c9a-f26b-432b-b8ea-9683f05952d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:54.161610 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef098c9a-f26b-432b-b8ea-9683f05952d1 None admin] PATH_INFO: `/v3/roles` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:54.162362 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef098c9a-f26b-432b-b8ea-9683f05952d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:51:54.162680 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef098c9a-f26b-432b-b8ea-9683f05952d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:54.164092 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef098c9a-f26b-432b-b8ea-9683f05952d1 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:54.174726 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 87/185] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 25 11:51:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:54.175563 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef098c9a-f26b-432b-b8ea-9683f05952d1 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:54.183555 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:54.196025 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6191a701-8073-484b-a913-59d00d8bd606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:54.196691 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191a701-8073-484b-a913-59d00d8bd606 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:54.196975 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191a701-8073-484b-a913-59d00d8bd606 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:54.197254 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191a701-8073-484b-a913-59d00d8bd606 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:54.198086 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6191a701-8073-484b-a913-59d00d8bd606 None admin] RBAC: Adding query filter params (role.id=0bb7b8a3ae8f4d03a7f575ca8904963c, scope.project.id=77abaefbc4da43f484b31efb185532a8, user.id=d56e0746442f4c68951b0eae41c997d3) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:51:54.198398 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6191a701-8073-484b-a913-59d00d8bd606 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:54.200436 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6191a701-8073-484b-a913-59d00d8bd606 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:54.206658 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 99/186] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 25 11:51:54 2022] GET /identity/v3/role_assignments?user.id=d56e0746442f4c68951b0eae41c997d3&scope.project.id=77abaefbc4da43f484b31efb185532a8&role.id=0bb7b8a3ae8f4d03a7f575ca8904963c => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:54.207740 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1bf6e-d6ce-4fe7-ac92-9e7906650ddf None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:54.208050 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1bf6e-d6ce-4fe7-ac92-9e7906650ddf None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:54.208328 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1bf6e-d6ce-4fe7-ac92-9e7906650ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:54.229346 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-c3f1bf6e-d6ce-4fe7-ac92-9e7906650ddf None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:51:54.230573 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-c3f1bf6e-d6ce-4fe7-ac92-9e7906650ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:51:54.256026 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:54.306447 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 100/187] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:51:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 11:51:54.307419 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f1bf6e-d6ce-4fe7-ac92-9e7906650ddf None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:54.309027 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef098c9a-f26b-432b-b8ea-9683f05952d1 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:54.346839 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352dd0e-132b-4f24-b482-89efd30711e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:54.347517 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352dd0e-132b-4f24-b482-89efd30711e7 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:54.347827 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352dd0e-132b-4f24-b482-89efd30711e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:54.348118 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352dd0e-132b-4f24-b482-89efd30711e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:54.348963 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0352dd0e-132b-4f24-b482-89efd30711e7 None admin] RBAC: Adding query filter params (role.id=1d75537a128747f180972029d0241cb4, scope.project.id=0499f6b6a46a4da2bb2ceedf8b6843b6, user.id=d56e0746442f4c68951b0eae41c997d3) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:51:54.349279 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0352dd0e-132b-4f24-b482-89efd30711e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:54.350754 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0352dd0e-132b-4f24-b482-89efd30711e7 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:54.367841 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 88/188] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 25 11:51:54 2022] GET /identity/v3/role_assignments?user.id=d56e0746442f4c68951b0eae41c997d3&scope.project.id=0499f6b6a46a4da2bb2ceedf8b6843b6&role.id=1d75537a128747f180972029d0241cb4 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:54.367841 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352dd0e-132b-4f24-b482-89efd30711e7 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:54.450894 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f1bf6e-d6ce-4fe7-ac92-9e7906650ddf None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:54.468699 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:54.499131 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f2efc-5676-4803-a82c-9268f4c96e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:54.500385 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f2efc-5676-4803-a82c-9268f4c96e30 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:54.500847 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f2efc-5676-4803-a82c-9268f4c96e30 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:54.501285 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f2efc-5676-4803-a82c-9268f4c96e30 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:54.513984 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83f2efc-5676-4803-a82c-9268f4c96e30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:51:54.523847 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-e83f2efc-5676-4803-a82c-9268f4c96e30 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 11:51:54.523847 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:51:54.523847 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:51:54.523847 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:51:54.523847 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:51:54.523847 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:51:54.523847 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:51:54.523847 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:51:54.523847 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:51:54.523847 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:51:54.523847 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:51:54.523847 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:51:54.523847 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:51:54.523847 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:51:54.523847 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:51:54.523847 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:51:54.524831 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:51:54.524831 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:51:54.524831 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:51:54.524831 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:51:54.524831 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:51:54.524831 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:51:54.524831 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:51:54.524831 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:51:54.524831 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:51:54.524831 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:51:54.524831 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:51:54.524831 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:51:54.524831 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:51:54.524831 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:51:54.524831 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:51:54.524831 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:51:54.525721 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:51:54.525721 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:51:54.525721 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:51:54.525721 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:51:54.525721 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:51:54.525721 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:51:54.525721 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:51:54.525721 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:51:54.525721 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:51:54.525721 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:51:54.525721 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 11:51:54.525721 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:51:54.526326 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352dd0e-132b-4f24-b482-89efd30711e7 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:54.533368 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 101/189] 10.222.0.44 () {56 vars in 1114 bytes} [Wed May 25 11:51:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:51:54.533368 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1475f1-a904-4b32-92a7-28d5f02af750 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:54.533368 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1475f1-a904-4b32-92a7-28d5f02af750 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:54.533368 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1475f1-a904-4b32-92a7-28d5f02af750 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:54.533368 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 102/190] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:51:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:51:54.535389 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1475f1-a904-4b32-92a7-28d5f02af750 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:54.560795 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:54.571540 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7516581-bf08-419e-a0f8-5890714b7966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:54.572434 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7516581-bf08-419e-a0f8-5890714b7966 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:54.572726 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7516581-bf08-419e-a0f8-5890714b7966 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:54.573008 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7516581-bf08-419e-a0f8-5890714b7966 None admin] PATH_INFO: `/v3/users/34f2136e8d224341a9aba9afb5a5b820` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:54.591558 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7516581-bf08-419e-a0f8-5890714b7966 None admin] RBAC: Authorizing `identity:get_user(user_id=34f2136e8d224341a9aba9afb5a5b820)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:54.593849 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7516581-bf08-419e-a0f8-5890714b7966 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:54.595557 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 89/191] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 25 11:51:54 2022] GET /identity/v3/users/34f2136e8d224341a9aba9afb5a5b820 => generated 283 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:54.596981 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7516581-bf08-419e-a0f8-5890714b7966 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:54.659610 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1475f1-a904-4b32-92a7-28d5f02af750 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:54.693660 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ea2ea2-b8f5-4cb3-ae7c-668ff94f8fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:54.694446 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea2ea2-b8f5-4cb3-ae7c-668ff94f8fe1 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:54.694728 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea2ea2-b8f5-4cb3-ae7c-668ff94f8fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:54.695007 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea2ea2-b8f5-4cb3-ae7c-668ff94f8fe1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:54.696190 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ea2ea2-b8f5-4cb3-ae7c-668ff94f8fe1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:54.697627 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ea2ea2-b8f5-4cb3-ae7c-668ff94f8fe1 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:54.699223 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 103/192] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:51:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:54.700412 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda28dc2-38c0-455d-8083-920378a49625 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:54.700695 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda28dc2-38c0-455d-8083-920378a49625 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:54.700968 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda28dc2-38c0-455d-8083-920378a49625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:54.701908 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7516581-bf08-419e-a0f8-5890714b7966 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:54.716863 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-dda28dc2-38c0-455d-8083-920378a49625 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:51:54.718045 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-dda28dc2-38c0-455d-8083-920378a49625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:51:54.728466 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:54.737627 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7fd34-a37a-4e72-a099-9deeb5024946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:54.738293 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7fd34-a37a-4e72-a099-9deeb5024946 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:54.738577 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7fd34-a37a-4e72-a099-9deeb5024946 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:54.738855 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7fd34-a37a-4e72-a099-9deeb5024946 None admin] PATH_INFO: `/v3/roles` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:54.739597 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c7fd34-a37a-4e72-a099-9deeb5024946 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:51:54.739930 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c7fd34-a37a-4e72-a099-9deeb5024946 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:54.741314 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c7fd34-a37a-4e72-a099-9deeb5024946 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:54.749289 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 90/193] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 25 11:51:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:54.750062 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7fd34-a37a-4e72-a099-9deeb5024946 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:54.787657 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 104/194] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:51:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 11:51:54.792365 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda28dc2-38c0-455d-8083-920378a49625 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:54.813649 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:54.855469 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7fd34-a37a-4e72-a099-9deeb5024946 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:54.889793 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77389e52-d0cf-4de4-9184-523b9558a493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:54.890443 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77389e52-d0cf-4de4-9184-523b9558a493 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:54.890736 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77389e52-d0cf-4de4-9184-523b9558a493 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:54.891014 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77389e52-d0cf-4de4-9184-523b9558a493 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:54.894326 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda28dc2-38c0-455d-8083-920378a49625 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:54.927383 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc3858d-3b4f-4305-a619-02b83306c33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:54.928069 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc3858d-3b4f-4305-a619-02b83306c33a None admin] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:54.928356 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc3858d-3b4f-4305-a619-02b83306c33a None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:54.928631 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc3858d-3b4f-4305-a619-02b83306c33a None admin] PATH_INFO: `/v3/users` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:54.929339 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc3858d-3b4f-4305-a619-02b83306c33a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:54.930778 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc3858d-3b4f-4305-a619-02b83306c33a None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:54.946099 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:54.950296 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 105/195] 10.222.0.44 () {60 vars in 1132 bytes} [Wed May 25 11:51:54 2022] POST /identity/v3/users => generated 297 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 11:51:54.951107 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc3858d-3b4f-4305-a619-02b83306c33a None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:54.971950 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77389e52-d0cf-4de4-9184-523b9558a493 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:54.973556 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77389e52-d0cf-4de4-9184-523b9558a493 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:55.032686 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:55.069112 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc3858d-3b4f-4305-a619-02b83306c33a None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:55.087863 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 91/196] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 25 11:51:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 11:51:55.087863 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77389e52-d0cf-4de4-9184-523b9558a493 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:55.112120 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a8d87-9b30-47ed-98cc-3bf020806499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:55.113146 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a8d87-9b30-47ed-98cc-3bf020806499 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:55.113487 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a8d87-9b30-47ed-98cc-3bf020806499 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:55.113867 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a8d87-9b30-47ed-98cc-3bf020806499 None admin] PATH_INFO: `/v3/users/34f2136e8d224341a9aba9afb5a5b820` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:55.115141 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796a8d87-9b30-47ed-98cc-3bf020806499 None admin] RBAC: Authorizing `identity:get_user(user_id=34f2136e8d224341a9aba9afb5a5b820)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:55.116663 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796a8d87-9b30-47ed-98cc-3bf020806499 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:55.118327 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 106/197] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 25 11:51:54 2022] GET /identity/v3/users/34f2136e8d224341a9aba9afb5a5b820 => generated 283 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:55.119109 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a8d87-9b30-47ed-98cc-3bf020806499 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:55.191046 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:55.208873 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77389e52-d0cf-4de4-9184-523b9558a493 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:55.251095 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a8d87-9b30-47ed-98cc-3bf020806499 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:55.256205 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7423f60-07c8-4531-9c5c-83dbfa5bd7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:55.257090 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7423f60-07c8-4531-9c5c-83dbfa5bd7dd None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:55.257455 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7423f60-07c8-4531-9c5c-83dbfa5bd7dd None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:55.257803 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7423f60-07c8-4531-9c5c-83dbfa5bd7dd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:55.276382 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7423f60-07c8-4531-9c5c-83dbfa5bd7dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:51:55.287026 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-f7423f60-07c8-4531-9c5c-83dbfa5bd7dd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 11:51:55.287026 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:51:55.287026 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:51:55.287026 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:51:55.287026 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:51:55.287026 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:51:55.287026 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:51:55.287026 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:51:55.287026 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:51:55.287026 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:51:55.287026 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:51:55.287026 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:51:55.287026 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:51:55.287026 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:51:55.287026 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:51:55.287026 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:51:55.288029 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:51:55.288029 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:51:55.288029 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:51:55.288029 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:51:55.288029 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:51:55.288029 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:51:55.288029 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:51:55.288029 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:51:55.288029 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:51:55.288029 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:51:55.288029 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:51:55.288029 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:51:55.288029 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:51:55.288029 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:51:55.288029 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:51:55.288029 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:51:55.288833 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:51:55.288833 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:51:55.288833 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:51:55.288833 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:51:55.288833 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:51:55.288833 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:51:55.288833 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:51:55.288833 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:51:55.288833 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:51:55.288833 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:51:55.288833 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 11:51:55.288833 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:51:55.288833 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 92/198] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 25 11:51:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:51:55.290091 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7423f60-07c8-4531-9c5c-83dbfa5bd7dd None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:55.299759 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ada32-e393-4110-bee7-f822fa15dea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:55.300659 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ada32-e393-4110-bee7-f822fa15dea7 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:55.300942 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ada32-e393-4110-bee7-f822fa15dea7 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:55.301217 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ada32-e393-4110-bee7-f822fa15dea7 None admin] PATH_INFO: `/v3/projects/fbdd1a23ea8a4df7ad5aa9fb346fe0da` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:55.302854 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848ada32-e393-4110-bee7-f822fa15dea7 None admin] RBAC: Authorizing `identity:get_project(project_id=fbdd1a23ea8a4df7ad5aa9fb346fe0da)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:55.304721 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848ada32-e393-4110-bee7-f822fa15dea7 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:55.306930 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 107/199] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 25 11:51:55 2022] GET /identity/v3/projects/fbdd1a23ea8a4df7ad5aa9fb346fe0da => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:55.307614 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ada32-e393-4110-bee7-f822fa15dea7 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:55.324077 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:55.412875 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7423f60-07c8-4531-9c5c-83dbfa5bd7dd None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:55.438086 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ada32-e393-4110-bee7-f822fa15dea7 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:55.461199 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139d7be6-ebfb-4480-ac98-e4f8db776a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:55.462152 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d7be6-ebfb-4480-ac98-e4f8db776a15 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:55.462774 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d7be6-ebfb-4480-ac98-e4f8db776a15 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:55.463617 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d7be6-ebfb-4480-ac98-e4f8db776a15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:55.474469 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636d08b-1785-4ee2-a3f7-b151c9e4392d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:55.475515 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636d08b-1785-4ee2-a3f7-b151c9e4392d None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:55.475654 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636d08b-1785-4ee2-a3f7-b151c9e4392d None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:55.475999 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636d08b-1785-4ee2-a3f7-b151c9e4392d None admin] PATH_INFO: `/v3/roles` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:55.476880 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9636d08b-1785-4ee2-a3f7-b151c9e4392d None admin] RBAC: Adding query filter params (name=reader) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:51:55.477260 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9636d08b-1785-4ee2-a3f7-b151c9e4392d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:55.478824 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9636d08b-1785-4ee2-a3f7-b151c9e4392d None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:55.487304 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:55.492688 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 108/200] 10.222.0.44 () {56 vars in 1101 bytes} [Wed May 25 11:51:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:55.493968 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636d08b-1785-4ee2-a3f7-b151c9e4392d None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:55.552266 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139d7be6-ebfb-4480-ac98-e4f8db776a15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:55.553855 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139d7be6-ebfb-4480-ac98-e4f8db776a15 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:55.587048 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:55.628880 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636d08b-1785-4ee2-a3f7-b151c9e4392d None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:55.667066 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc45183-60f7-4926-86f2-6178ed1c3f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:55.667717 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc45183-60f7-4926-86f2-6178ed1c3f7b None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:55.668048 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc45183-60f7-4926-86f2-6178ed1c3f7b None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:55.668324 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc45183-60f7-4926-86f2-6178ed1c3f7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:55.669151 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc45183-60f7-4926-86f2-6178ed1c3f7b None admin] RBAC: Adding query filter params (role.id=2fe5c1214bcc4c1bafa5a4545161518d, scope.project.id=fbdd1a23ea8a4df7ad5aa9fb346fe0da, user.id=34f2136e8d224341a9aba9afb5a5b820) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:51:55.669465 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc45183-60f7-4926-86f2-6178ed1c3f7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:55.670893 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc45183-60f7-4926-86f2-6178ed1c3f7b None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:55.672528 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 93/201] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 25 11:51:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 11:51:55.678351 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139d7be6-ebfb-4480-ac98-e4f8db776a15 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:55.684453 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 109/202] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 25 11:51:55 2022] GET /identity/v3/role_assignments?user.id=34f2136e8d224341a9aba9afb5a5b820&scope.project.id=fbdd1a23ea8a4df7ad5aa9fb346fe0da&role.id=2fe5c1214bcc4c1bafa5a4545161518d => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:55.685480 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc45183-60f7-4926-86f2-6178ed1c3f7b None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:55.781109 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:55.855399 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc45183-60f7-4926-86f2-6178ed1c3f7b None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:55.895766 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5218dd-adce-49cf-9c3d-2f00d5a0cad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:55.897169 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5218dd-adce-49cf-9c3d-2f00d5a0cad0 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:55.897722 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5218dd-adce-49cf-9c3d-2f00d5a0cad0 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:55.898468 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5218dd-adce-49cf-9c3d-2f00d5a0cad0 None admin] PATH_INFO: `/v3/projects/fbdd1a23ea8a4df7ad5aa9fb346fe0da` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:55.900157 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5218dd-adce-49cf-9c3d-2f00d5a0cad0 None admin] RBAC: Authorizing `identity:get_project(project_id=fbdd1a23ea8a4df7ad5aa9fb346fe0da)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:55.901923 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5218dd-adce-49cf-9c3d-2f00d5a0cad0 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:55.902160 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139d7be6-ebfb-4480-ac98-e4f8db776a15 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:55.904900 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 110/203] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 25 11:51:55 2022] GET /identity/v3/projects/fbdd1a23ea8a4df7ad5aa9fb346fe0da => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:55.912255 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5218dd-adce-49cf-9c3d-2f00d5a0cad0 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:55.915634 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:55.975115 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e965af5-3f7d-440c-8ad7-376bc8eb69a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:55.976189 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e965af5-3f7d-440c-8ad7-376bc8eb69a2 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:55.976295 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e965af5-3f7d-440c-8ad7-376bc8eb69a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:55.976558 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e965af5-3f7d-440c-8ad7-376bc8eb69a2 None admin] PATH_INFO: `/v3/users/194c46c6242d45c5b38351e3eb7ebd3a` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:55.978546 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e965af5-3f7d-440c-8ad7-376bc8eb69a2 None admin] RBAC: Authorizing `identity:get_user(user_id=194c46c6242d45c5b38351e3eb7ebd3a)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:55.980058 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e965af5-3f7d-440c-8ad7-376bc8eb69a2 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:55.982444 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 94/204] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 25 11:51:55 2022] GET /identity/v3/users/194c46c6242d45c5b38351e3eb7ebd3a => generated 289 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:55.987477 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e965af5-3f7d-440c-8ad7-376bc8eb69a2 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:56.085575 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5218dd-adce-49cf-9c3d-2f00d5a0cad0 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:56.125159 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da66ab8-e9e3-4c5d-9820-81e097d47cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:56.125747 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da66ab8-e9e3-4c5d-9820-81e097d47cd9 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:56.126023 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da66ab8-e9e3-4c5d-9820-81e097d47cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:56.126292 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da66ab8-e9e3-4c5d-9820-81e097d47cd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:56.127122 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da66ab8-e9e3-4c5d-9820-81e097d47cd9 None admin] RBAC: Adding query filter params (role.id=1d75537a128747f180972029d0241cb4, scope.project.id=fbdd1a23ea8a4df7ad5aa9fb346fe0da, user.id=34f2136e8d224341a9aba9afb5a5b820) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:51:56.127434 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da66ab8-e9e3-4c5d-9820-81e097d47cd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:56.128891 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da66ab8-e9e3-4c5d-9820-81e097d47cd9 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:56.133969 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e965af5-3f7d-440c-8ad7-376bc8eb69a2 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:56.134844 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 111/205] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 25 11:51:55 2022] GET /identity/v3/role_assignments?user.id=34f2136e8d224341a9aba9afb5a5b820&scope.project.id=fbdd1a23ea8a4df7ad5aa9fb346fe0da&role.id=1d75537a128747f180972029d0241cb4 => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:56.173037 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:56.218536 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3e57a-797f-4e2e-91f3-4d608ce2dab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:56.219224 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3e57a-797f-4e2e-91f3-4d608ce2dab0 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:56.219512 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3e57a-797f-4e2e-91f3-4d608ce2dab0 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:56.219807 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3e57a-797f-4e2e-91f3-4d608ce2dab0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:56.325731 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b3e57a-797f-4e2e-91f3-4d608ce2dab0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:56.327593 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b3e57a-797f-4e2e-91f3-4d608ce2dab0 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:56.472858 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 95/206] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 25 11:51:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 11:51:56.479385 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da66ab8-e9e3-4c5d-9820-81e097d47cd9 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:56.567690 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:56.614465 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da66ab8-e9e3-4c5d-9820-81e097d47cd9 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:56.657798 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed3c7ec-3ce4-4aee-83ce-33960c2683c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:56.658669 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3c7ec-3ce4-4aee-83ce-33960c2683c4 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:56.658959 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3c7ec-3ce4-4aee-83ce-33960c2683c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:56.659243 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3c7ec-3ce4-4aee-83ce-33960c2683c4 None admin] PATH_INFO: `/v3/projects/0499f6b6a46a4da2bb2ceedf8b6843b6` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:56.660458 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed3c7ec-3ce4-4aee-83ce-33960c2683c4 None admin] RBAC: Authorizing `identity:get_project(project_id=0499f6b6a46a4da2bb2ceedf8b6843b6)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:56.661914 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed3c7ec-3ce4-4aee-83ce-33960c2683c4 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:56.663921 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 112/207] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 25 11:51:56 2022] GET /identity/v3/projects/0499f6b6a46a4da2bb2ceedf8b6843b6 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:56.670398 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3e57a-797f-4e2e-91f3-4d608ce2dab0 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:56.698328 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:56.797996 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3e57a-797f-4e2e-91f3-4d608ce2dab0 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:56.836811 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b570ac62-2fef-404f-9620-fbf880aa31cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:56.838295 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b570ac62-2fef-404f-9620-fbf880aa31cb None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:56.839001 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b570ac62-2fef-404f-9620-fbf880aa31cb None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:56.839674 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b570ac62-2fef-404f-9620-fbf880aa31cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:56.840766 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b570ac62-2fef-404f-9620-fbf880aa31cb None admin] RBAC: Adding query filter params (role.id=038496e26bf34707a6fa4de9bc368de5, scope.project.id=0499f6b6a46a4da2bb2ceedf8b6843b6, user.id=194c46c6242d45c5b38351e3eb7ebd3a) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:51:56.841294 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b570ac62-2fef-404f-9620-fbf880aa31cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:56.842935 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b570ac62-2fef-404f-9620-fbf880aa31cb None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:56.849478 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 96/208] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 25 11:51:56 2022] GET /identity/v3/role_assignments?user.id=194c46c6242d45c5b38351e3eb7ebd3a&scope.project.id=0499f6b6a46a4da2bb2ceedf8b6843b6&role.id=038496e26bf34707a6fa4de9bc368de5 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:57.710415 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03db5f-498e-4a6b-9b8b-901495e23c81 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:57.710930 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03db5f-498e-4a6b-9b8b-901495e23c81 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:57.711005 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03db5f-498e-4a6b-9b8b-901495e23c81 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:57.712436 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 113/209] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:51:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:51:57.718303 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159753b6-9d7f-4a78-bdd6-1e172f3a3ddb None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:57.719140 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159753b6-9d7f-4a78-bdd6-1e172f3a3ddb None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:57.719627 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159753b6-9d7f-4a78-bdd6-1e172f3a3ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:57.737201 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-159753b6-9d7f-4a78-bdd6-1e172f3a3ddb None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:51:57.738663 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-159753b6-9d7f-4a78-bdd6-1e172f3a3ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:51:57.795117 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac20a0-c50d-4c71-ab65-a63623bb0e9d None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:57.795726 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac20a0-c50d-4c71-ab65-a63623bb0e9d None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:57.796232 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac20a0-c50d-4c71-ab65-a63623bb0e9d None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:57.797819 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 114/210] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:51:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 11:51:57.810456 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61efca06-14cd-421e-803b-0fdbc6e30cf0 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:57.810753 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61efca06-14cd-421e-803b-0fdbc6e30cf0 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:57.811010 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61efca06-14cd-421e-803b-0fdbc6e30cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:57.817632 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 97/211] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:51:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 11:51:57.828842 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-61efca06-14cd-421e-803b-0fdbc6e30cf0 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:51:57.830023 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-61efca06-14cd-421e-803b-0fdbc6e30cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:51:57.844251 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159753b6-9d7f-4a78-bdd6-1e172f3a3ddb None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:57.856841 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:57.901414 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 115/212] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:51:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 11:51:57.929409 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61efca06-14cd-421e-803b-0fdbc6e30cf0 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:57.951895 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159753b6-9d7f-4a78-bdd6-1e172f3a3ddb None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:57.988956 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aba78cb-0166-4e81-9017-895dfa0c5881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:57.990243 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba78cb-0166-4e81-9017-895dfa0c5881 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:57.990751 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba78cb-0166-4e81-9017-895dfa0c5881 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:57.991229 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba78cb-0166-4e81-9017-895dfa0c5881 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:57.993198 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:58.004351 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aba78cb-0166-4e81-9017-895dfa0c5881 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:51:58.012995 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-1aba78cb-0166-4e81-9017-895dfa0c5881 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 11:51:58.012995 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:51:58.012995 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:51:58.012995 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:51:58.012995 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:51:58.012995 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:51:58.012995 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:51:58.012995 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:51:58.012995 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:51:58.012995 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:51:58.012995 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:51:58.012995 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:51:58.012995 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:51:58.012995 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:51:58.012995 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:51:58.012995 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:51:58.013902 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:51:58.013902 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:51:58.013902 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:51:58.013902 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:51:58.013902 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:51:58.013902 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:51:58.013902 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:51:58.013902 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:51:58.013902 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:51:58.013902 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:51:58.013902 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:51:58.013902 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:51:58.013902 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:51:58.013902 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:51:58.013902 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:51:58.013902 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:51:58.014703 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:51:58.014703 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:51:58.014703 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:51:58.014703 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:51:58.014703 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:51:58.014703 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:51:58.014703 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:51:58.014703 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:51:58.014703 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:51:58.014703 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:51:58.014703 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 11:51:58.014703 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:51:58.017213 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 98/213] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 25 11:51:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:51:58.023201 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aba78cb-0166-4e81-9017-895dfa0c5881 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:58.033477 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61efca06-14cd-421e-803b-0fdbc6e30cf0 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:58.070720 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a5c0c-1639-40bb-9672-dba09f7df2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:58.071519 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a5c0c-1639-40bb-9672-dba09f7df2a4 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:58.071824 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a5c0c-1639-40bb-9672-dba09f7df2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:58.072104 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a5c0c-1639-40bb-9672-dba09f7df2a4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:58.073270 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a5c0c-1639-40bb-9672-dba09f7df2a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:58.075374 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a5c0c-1639-40bb-9672-dba09f7df2a4 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:58.082053 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 116/214] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:51:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:51:58.082884 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a5c0c-1639-40bb-9672-dba09f7df2a4 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:58.102708 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:58.137877 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aba78cb-0166-4e81-9017-895dfa0c5881 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:58.186596 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a5c0c-1639-40bb-9672-dba09f7df2a4 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:58.187003 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd8299-31a7-4af1-9e16-43807971c4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:58.188232 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd8299-31a7-4af1-9e16-43807971c4d1 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:58.188734 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd8299-31a7-4af1-9e16-43807971c4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:58.190108 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd8299-31a7-4af1-9e16-43807971c4d1 None admin] PATH_INFO: `/v3/roles` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:58.191077 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cd8299-31a7-4af1-9e16-43807971c4d1 None admin] RBAC: Adding query filter params (name=member) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:51:58.191593 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cd8299-31a7-4af1-9e16-43807971c4d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:58.193225 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cd8299-31a7-4af1-9e16-43807971c4d1 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:58.206408 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 99/215] 10.222.0.44 () {56 vars in 1101 bytes} [Wed May 25 11:51:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:51:58.213068 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd8299-31a7-4af1-9e16-43807971c4d1 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:58.230709 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:58.239344 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc64b0b-e163-4e3e-b681-de96ef0f1d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:58.240488 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc64b0b-e163-4e3e-b681-de96ef0f1d0b None admin] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:58.241010 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc64b0b-e163-4e3e-b681-de96ef0f1d0b None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:58.241514 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc64b0b-e163-4e3e-b681-de96ef0f1d0b None admin] PATH_INFO: `/v3/users` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:58.243128 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc64b0b-e163-4e3e-b681-de96ef0f1d0b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:58.245533 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc64b0b-e163-4e3e-b681-de96ef0f1d0b None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:58.274444 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 117/216] 10.222.0.44 () {60 vars in 1132 bytes} [Wed May 25 11:51:58 2022] POST /identity/v3/users => generated 297 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 11:51:58.345534 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd8299-31a7-4af1-9e16-43807971c4d1 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:58.384090 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:58.390897 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1099251-a339-49f7-9caa-5eb9aa99ddbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:58.392280 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1099251-a339-49f7-9caa-5eb9aa99ddbe None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:58.392835 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1099251-a339-49f7-9caa-5eb9aa99ddbe None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:58.393318 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1099251-a339-49f7-9caa-5eb9aa99ddbe None admin] PATH_INFO: `/v3/users/4c27c50067cb4c8b9f46b4b007e9bd66` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:58.411457 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1099251-a339-49f7-9caa-5eb9aa99ddbe None admin] RBAC: Authorizing `identity:get_user(user_id=4c27c50067cb4c8b9f46b4b007e9bd66)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:58.413553 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1099251-a339-49f7-9caa-5eb9aa99ddbe None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:58.415633 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 100/217] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 25 11:51:58 2022] GET /identity/v3/users/4c27c50067cb4c8b9f46b4b007e9bd66 => generated 297 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:58.422050 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc64b0b-e163-4e3e-b681-de96ef0f1d0b None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:58.437810 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c0695-c889-4b18-8fe4-4126b00d5a8b None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:58.438126 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c0695-c889-4b18-8fe4-4126b00d5a8b None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:58.438381 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c0695-c889-4b18-8fe4-4126b00d5a8b None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:58.439843 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 101/218] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:51:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 11:51:58.445441 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af6c849-fd29-4c5b-bbe6-ec0af86a4ce9 None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:58.445746 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af6c849-fd29-4c5b-bbe6-ec0af86a4ce9 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:58.446006 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af6c849-fd29-4c5b-bbe6-ec0af86a4ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:58.465489 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-6af6c849-fd29-4c5b-bbe6-ec0af86a4ce9 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:51:58.466701 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-6af6c849-fd29-4c5b-bbe6-ec0af86a4ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:51:58.549116 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 102/219] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:51:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 11:51:58.557527 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc64b0b-e163-4e3e-b681-de96ef0f1d0b None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:58.572755 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af6c849-fd29-4c5b-bbe6-ec0af86a4ce9 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:58.599084 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d27c62-4c86-4e56-ba3a-2e1a9798175b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:58.599750 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d27c62-4c86-4e56-ba3a-2e1a9798175b None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:58.600099 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d27c62-4c86-4e56-ba3a-2e1a9798175b None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:58.600378 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d27c62-4c86-4e56-ba3a-2e1a9798175b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:58.670803 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:58.690856 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d27c62-4c86-4e56-ba3a-2e1a9798175b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:58.694175 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d27c62-4c86-4e56-ba3a-2e1a9798175b None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:58.700949 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af6c849-fd29-4c5b-bbe6-ec0af86a4ce9 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:58.728589 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:58.747434 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef29afa8-c098-48af-b120-fd56d5b0ec87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:58.748428 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29afa8-c098-48af-b120-fd56d5b0ec87 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:58.748722 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29afa8-c098-48af-b120-fd56d5b0ec87 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:58.749373 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29afa8-c098-48af-b120-fd56d5b0ec87 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:58.762916 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef29afa8-c098-48af-b120-fd56d5b0ec87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:51:58.773584 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-ef29afa8-c098-48af-b120-fd56d5b0ec87 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 11:51:58.773584 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:51:58.773584 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:51:58.773584 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:51:58.773584 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:51:58.773584 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:51:58.773584 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:51:58.773584 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:51:58.773584 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:51:58.773584 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:51:58.773584 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:51:58.773584 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:51:58.773584 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:51:58.773584 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:51:58.773584 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:51:58.773584 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:51:58.774496 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:51:58.774496 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:51:58.774496 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:51:58.774496 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:51:58.774496 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:51:58.774496 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:51:58.774496 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:51:58.774496 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:51:58.774496 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:51:58.774496 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:51:58.774496 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:51:58.774496 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:51:58.774496 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:51:58.774496 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:51:58.774496 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:51:58.774496 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:51:58.775277 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:51:58.775277 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:51:58.775277 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:51:58.775277 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:51:58.775277 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:51:58.775277 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:51:58.775277 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:51:58.775277 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:51:58.775277 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:51:58.775277 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:51:58.775277 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 11:51:58.775277 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:51:58.775908 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 103/220] 10.222.0.44 () {56 vars in 1096 bytes} [Wed May 25 11:51:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:51:58.777111 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c893985-f4ca-45d5-99c8-18fd1078a0cc None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:58.777941 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c893985-f4ca-45d5-99c8-18fd1078a0cc None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:58.778467 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c893985-f4ca-45d5-99c8-18fd1078a0cc None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:58.779778 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 104/221] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:51:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:51:58.782719 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c893985-f4ca-45d5-99c8-18fd1078a0cc None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:58.822145 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 118/222] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 25 11:51:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 11:51:58.827984 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15469f-ce48-4e9c-be2a-afb6fe269825 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:58.827984 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15469f-ce48-4e9c-be2a-afb6fe269825 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:58.827984 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15469f-ce48-4e9c-be2a-afb6fe269825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:58.847884 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-7d15469f-ce48-4e9c-be2a-afb6fe269825 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:51:58.849059 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-7d15469f-ce48-4e9c-be2a-afb6fe269825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:51:58.919715 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c893985-f4ca-45d5-99c8-18fd1078a0cc None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:58.921036 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 119/223] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:51:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 11:51:58.921693 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d15469f-ce48-4e9c-be2a-afb6fe269825 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:58.941747 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:58.964987 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221d938-385a-4d90-8818-8dc2144d041e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:58.966024 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221d938-385a-4d90-8818-8dc2144d041e None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:58.966515 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221d938-385a-4d90-8818-8dc2144d041e None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:58.966993 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221d938-385a-4d90-8818-8dc2144d041e None admin] PATH_INFO: `/v3/roles` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:58.968481 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9221d938-385a-4d90-8818-8dc2144d041e None admin] RBAC: Adding query filter params (name=admin) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:51:58.969024 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9221d938-385a-4d90-8818-8dc2144d041e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:58.970983 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9221d938-385a-4d90-8818-8dc2144d041e None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:58.983530 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 105/224] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 25 11:51:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:51:58.984806 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221d938-385a-4d90-8818-8dc2144d041e None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:59.034483 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d15469f-ce48-4e9c-be2a-afb6fe269825 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:59.040022 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:59.074781 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b60547-9330-41b2-8993-75b883979c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:59.076028 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b60547-9330-41b2-8993-75b883979c45 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:59.076570 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b60547-9330-41b2-8993-75b883979c45 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:59.077040 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b60547-9330-41b2-8993-75b883979c45 None admin] PATH_INFO: `/v3/projects/fbdd1a23ea8a4df7ad5aa9fb346fe0da` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:59.078436 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b60547-9330-41b2-8993-75b883979c45 None admin] RBAC: Authorizing `identity:get_project(project_id=fbdd1a23ea8a4df7ad5aa9fb346fe0da)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:59.080241 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b60547-9330-41b2-8993-75b883979c45 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:59.082118 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 120/225] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 25 11:51:58 2022] GET /identity/v3/projects/fbdd1a23ea8a4df7ad5aa9fb346fe0da => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:59.083060 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b60547-9330-41b2-8993-75b883979c45 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:59.111506 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221d938-385a-4d90-8818-8dc2144d041e None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:59.148675 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec9acf3-920d-4304-8c9f-eb0049c5f65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:59.149491 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9acf3-920d-4304-8c9f-eb0049c5f65f None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:59.149782 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9acf3-920d-4304-8c9f-eb0049c5f65f None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:59.150064 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9acf3-920d-4304-8c9f-eb0049c5f65f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:59.162065 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec9acf3-920d-4304-8c9f-eb0049c5f65f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:51:59.178761 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-cec9acf3-920d-4304-8c9f-eb0049c5f65f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 11:51:59.178761 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:51:59.178761 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:51:59.178761 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:51:59.178761 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:51:59.178761 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:51:59.178761 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:51:59.178761 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:51:59.178761 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:51:59.178761 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:51:59.178761 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:51:59.178761 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:51:59.178761 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:51:59.178761 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:51:59.178761 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:51:59.178761 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:51:59.179689 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:51:59.179689 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:51:59.179689 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:51:59.179689 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:51:59.179689 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:51:59.179689 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:51:59.179689 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:51:59.179689 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:51:59.179689 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:51:59.179689 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:51:59.179689 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:51:59.179689 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:51:59.179689 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:51:59.179689 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:51:59.179689 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:51:59.179689 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:51:59.181056 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:51:59.181056 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:51:59.181056 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:51:59.181056 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:51:59.181056 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:51:59.181056 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:51:59.181056 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:51:59.181056 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:51:59.181056 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:51:59.181056 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:51:59.181056 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 11:51:59.181056 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:51:59.181056 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 106/226] 10.222.0.44 () {56 vars in 1114 bytes} [Wed May 25 11:51:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:51:59.181056 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec9acf3-920d-4304-8c9f-eb0049c5f65f None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:59.194381 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:59.216111 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b60547-9330-41b2-8993-75b883979c45 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:59.261783 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff4234d-ae0e-46f2-b45b-0d81d0755e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:59.263649 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4234d-ae0e-46f2-b45b-0d81d0755e27 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:59.264158 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4234d-ae0e-46f2-b45b-0d81d0755e27 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:59.264663 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4234d-ae0e-46f2-b45b-0d81d0755e27 None admin] PATH_INFO: `/v3/users/34f2136e8d224341a9aba9afb5a5b820` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:59.266507 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff4234d-ae0e-46f2-b45b-0d81d0755e27 None admin] RBAC: Authorizing `identity:get_user(user_id=34f2136e8d224341a9aba9afb5a5b820)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:59.269140 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff4234d-ae0e-46f2-b45b-0d81d0755e27 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:59.272474 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 121/227] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 25 11:51:59 2022] GET /identity/v3/users/34f2136e8d224341a9aba9afb5a5b820 => generated 283 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:59.273779 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff4234d-ae0e-46f2-b45b-0d81d0755e27 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:59.308830 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec9acf3-920d-4304-8c9f-eb0049c5f65f None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:59.310674 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:59.346576 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c4ca5-15e2-4bb1-aedd-eb6578a78d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:59.347166 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c4ca5-15e2-4bb1-aedd-eb6578a78d92 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:59.347453 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c4ca5-15e2-4bb1-aedd-eb6578a78d92 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:59.347734 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c4ca5-15e2-4bb1-aedd-eb6578a78d92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:59.348615 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c4ca5-15e2-4bb1-aedd-eb6578a78d92 None admin] RBAC: Adding query filter params (role.id=0bb7b8a3ae8f4d03a7f575ca8904963c, scope.project.id=fbdd1a23ea8a4df7ad5aa9fb346fe0da, user.id=4c27c50067cb4c8b9f46b4b007e9bd66) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:51:59.348932 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c4ca5-15e2-4bb1-aedd-eb6578a78d92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:59.350380 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c4ca5-15e2-4bb1-aedd-eb6578a78d92 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:59.357118 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 107/228] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 25 11:51:59 2022] GET /identity/v3/role_assignments?user.id=4c27c50067cb4c8b9f46b4b007e9bd66&scope.project.id=fbdd1a23ea8a4df7ad5aa9fb346fe0da&role.id=0bb7b8a3ae8f4d03a7f575ca8904963c => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:59.357709 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c4ca5-15e2-4bb1-aedd-eb6578a78d92 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:59.420581 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff4234d-ae0e-46f2-b45b-0d81d0755e27 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:59.460194 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3061ca-a585-4c5a-ba45-b6d96e2917ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:59.461233 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3061ca-a585-4c5a-ba45-b6d96e2917ca None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:59.461711 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3061ca-a585-4c5a-ba45-b6d96e2917ca None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:59.462178 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3061ca-a585-4c5a-ba45-b6d96e2917ca None admin] PATH_INFO: `/v3/roles` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:59.463156 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3061ca-a585-4c5a-ba45-b6d96e2917ca None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:51:59.463655 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3061ca-a585-4c5a-ba45-b6d96e2917ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:59.465895 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3061ca-a585-4c5a-ba45-b6d96e2917ca None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:59.474626 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c4ca5-15e2-4bb1-aedd-eb6578a78d92 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:59.475258 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 122/229] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 25 11:51:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:59.498531 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3061ca-a585-4c5a-ba45-b6d96e2917ca None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:59.522186 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7a0fc-f5ba-4c05-a148-c1260c0b7b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:59.523345 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7a0fc-f5ba-4c05-a148-c1260c0b7b08 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:59.523633 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7a0fc-f5ba-4c05-a148-c1260c0b7b08 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:59.523953 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7a0fc-f5ba-4c05-a148-c1260c0b7b08 None admin] PATH_INFO: `/v3/projects/fbdd1a23ea8a4df7ad5aa9fb346fe0da` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:59.528950 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b7a0fc-f5ba-4c05-a148-c1260c0b7b08 None admin] RBAC: Authorizing `identity:get_project(project_id=fbdd1a23ea8a4df7ad5aa9fb346fe0da)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:59.528950 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b7a0fc-f5ba-4c05-a148-c1260c0b7b08 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:59.529585 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 108/230] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 25 11:51:59 2022] GET /identity/v3/projects/fbdd1a23ea8a4df7ad5aa9fb346fe0da => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:51:59.534292 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:59.540219 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7a0fc-f5ba-4c05-a148-c1260c0b7b08 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:59.619339 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:59.646499 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3061ca-a585-4c5a-ba45-b6d96e2917ca None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:59.709684 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a04e45-bae3-4047-a832-873ea7e70e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:59.710921 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a04e45-bae3-4047-a832-873ea7e70e11 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:59.711391 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a04e45-bae3-4047-a832-873ea7e70e11 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:59.711940 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a04e45-bae3-4047-a832-873ea7e70e11 None admin] PATH_INFO: `/v3/users/34f2136e8d224341a9aba9afb5a5b820` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:59.712985 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7a0fc-f5ba-4c05-a148-c1260c0b7b08 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:59.713581 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a04e45-bae3-4047-a832-873ea7e70e11 None admin] RBAC: Authorizing `identity:get_user(user_id=34f2136e8d224341a9aba9afb5a5b820)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:59.715576 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a04e45-bae3-4047-a832-873ea7e70e11 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:59.721758 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 123/231] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 25 11:51:59 2022] GET /identity/v3/users/34f2136e8d224341a9aba9afb5a5b820 => generated 283 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:51:59.722944 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a04e45-bae3-4047-a832-873ea7e70e11 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:51:59.780085 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d09f7-7532-4ec8-b21d-3e46bd3830e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:59.780998 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d09f7-7532-4ec8-b21d-3e46bd3830e4 None admin] REQUEST_METHOD: `PUT` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:59.781295 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d09f7-7532-4ec8-b21d-3e46bd3830e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:59.781561 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d09f7-7532-4ec8-b21d-3e46bd3830e4 None admin] PATH_INFO: `/v3/projects/fbdd1a23ea8a4df7ad5aa9fb346fe0da/users/34f2136e8d224341a9aba9afb5a5b820/roles/2fe5c1214bcc4c1bafa5a4545161518d` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:59.786405 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78d09f7-7532-4ec8-b21d-3e46bd3830e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=fbdd1a23ea8a4df7ad5aa9fb346fe0da, user_id=34f2136e8d224341a9aba9afb5a5b820, role_id=2fe5c1214bcc4c1bafa5a4545161518d)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:59.787828 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78d09f7-7532-4ec8-b21d-3e46bd3830e4 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:59.812320 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 109/232] 10.222.0.44 () {58 vars in 1439 bytes} [Wed May 25 11:51:59 2022] PUT /identity/v3/projects/fbdd1a23ea8a4df7ad5aa9fb346fe0da/users/34f2136e8d224341a9aba9afb5a5b820/roles/2fe5c1214bcc4c1bafa5a4545161518d => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 11:51:59.867313 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:51:59.899403 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a04e45-bae3-4047-a832-873ea7e70e11 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:51:59.946432 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53700ccd-f434-4451-95b9-ccaf41bfb4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:51:59.947331 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53700ccd-f434-4451-95b9-ccaf41bfb4a1 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:51:59.947621 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53700ccd-f434-4451-95b9-ccaf41bfb4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:51:59.947930 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53700ccd-f434-4451-95b9-ccaf41bfb4a1 None admin] PATH_INFO: `/v3/projects/fbdd1a23ea8a4df7ad5aa9fb346fe0da` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:51:59.949252 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53700ccd-f434-4451-95b9-ccaf41bfb4a1 None admin] RBAC: Authorizing `identity:get_project(project_id=fbdd1a23ea8a4df7ad5aa9fb346fe0da)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:51:59.950798 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53700ccd-f434-4451-95b9-ccaf41bfb4a1 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:51:59.952998 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 124/233] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 25 11:51:59 2022] GET /identity/v3/projects/fbdd1a23ea8a4df7ad5aa9fb346fe0da => generated 302 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:51:59.958843 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d09f7-7532-4ec8-b21d-3e46bd3830e4 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:00.087569 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:00.097786 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d09f7-7532-4ec8-b21d-3e46bd3830e4 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:00.142405 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed1b88c-0e46-412f-9c2b-525d1f9d4ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:00.143363 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1b88c-0e46-412f-9c2b-525d1f9d4ebe None admin] REQUEST_METHOD: `PUT` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:00.143648 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1b88c-0e46-412f-9c2b-525d1f9d4ebe None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:00.144001 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1b88c-0e46-412f-9c2b-525d1f9d4ebe None admin] PATH_INFO: `/v3/projects/fbdd1a23ea8a4df7ad5aa9fb346fe0da/users/34f2136e8d224341a9aba9afb5a5b820/roles/1d75537a128747f180972029d0241cb4` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:00.149763 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed1b88c-0e46-412f-9c2b-525d1f9d4ebe None admin] RBAC: Authorizing `identity:create_grant(project_id=fbdd1a23ea8a4df7ad5aa9fb346fe0da, user_id=34f2136e8d224341a9aba9afb5a5b820, role_id=1d75537a128747f180972029d0241cb4)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:00.151177 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed1b88c-0e46-412f-9c2b-525d1f9d4ebe None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:00.179563 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 110/234] 10.222.0.44 () {58 vars in 1439 bytes} [Wed May 25 11:51:59 2022] PUT /identity/v3/projects/fbdd1a23ea8a4df7ad5aa9fb346fe0da/users/34f2136e8d224341a9aba9afb5a5b820/roles/1d75537a128747f180972029d0241cb4 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 11:52:01.106701 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b15e4f4-3575-4892-a359-12de3b91c6df None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:01.107217 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b15e4f4-3575-4892-a359-12de3b91c6df None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:01.107291 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b15e4f4-3575-4892-a359-12de3b91c6df None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:01.108778 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 125/235] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:52:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:52:01.122696 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c65f9-cbba-4206-b7f2-1e3fe34a5e9b None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:01.123095 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c65f9-cbba-4206-b7f2-1e3fe34a5e9b None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:01.123260 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c65f9-cbba-4206-b7f2-1e3fe34a5e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:01.152040 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-714c65f9-cbba-4206-b7f2-1e3fe34a5e9b None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:52:01.153268 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-714c65f9-cbba-4206-b7f2-1e3fe34a5e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:52:01.219190 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2906807-f118-41d4-995a-c22f19b11b24 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:01.219642 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2906807-f118-41d4-995a-c22f19b11b24 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:01.220049 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2906807-f118-41d4-995a-c22f19b11b24 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:01.221642 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 126/236] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:52:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 11:52:01.227548 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758218cc-0666-4f35-ba9e-ce45d02b0369 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:01.227870 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758218cc-0666-4f35-ba9e-ce45d02b0369 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:01.228158 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758218cc-0666-4f35-ba9e-ce45d02b0369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:01.256964 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-758218cc-0666-4f35-ba9e-ce45d02b0369 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:52:01.258151 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-758218cc-0666-4f35-ba9e-ce45d02b0369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:52:01.262605 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 111/237] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:52:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 11:52:01.287856 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c65f9-cbba-4206-b7f2-1e3fe34a5e9b None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:01.401903 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:01.422163 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c65f9-cbba-4206-b7f2-1e3fe34a5e9b None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:01.429144 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 127/238] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:52:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 11:52:01.468344 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db04c84-767c-4aa9-8459-5a34f2e1585e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:01.469564 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db04c84-767c-4aa9-8459-5a34f2e1585e None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:01.470054 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db04c84-767c-4aa9-8459-5a34f2e1585e None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:01.470544 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db04c84-767c-4aa9-8459-5a34f2e1585e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:01.479348 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758218cc-0666-4f35-ba9e-ce45d02b0369 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:01.484216 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db04c84-767c-4aa9-8459-5a34f2e1585e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:52:01.492309 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-4db04c84-767c-4aa9-8459-5a34f2e1585e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 11:52:01.492309 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:01.492309 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:01.492309 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:01.492309 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:01.492309 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:01.492309 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:01.492309 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:01.492309 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:01.492309 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:01.492309 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:01.492309 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:01.492309 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:52:01.492309 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:52:01.492309 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:52:01.492309 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:52:01.493203 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:52:01.493203 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:52:01.493203 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:52:01.493203 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:52:01.493203 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:01.493203 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:01.493203 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:01.493203 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:01.493203 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:01.493203 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:01.493203 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:01.493203 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:52:01.493203 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:01.493203 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:01.493203 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:01.493203 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:01.494007 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:01.494007 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:01.494007 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:01.494007 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:01.494007 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:52:01.494007 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:52:01.494007 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:52:01.494007 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:52:01.494007 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:52:01.494007 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:52:01.494007 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 11:52:01.494007 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:52:01.496497 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 112/239] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 25 11:52:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 11:52:01.508771 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db04c84-767c-4aa9-8459-5a34f2e1585e None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:01.611629 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:01.620841 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db04c84-767c-4aa9-8459-5a34f2e1585e None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:01.643111 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758218cc-0666-4f35-ba9e-ce45d02b0369 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:01.663327 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40dd8ea-b8ad-45e2-b73c-462be5e75a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:01.664029 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40dd8ea-b8ad-45e2-b73c-462be5e75a1a None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:01.664324 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40dd8ea-b8ad-45e2-b73c-462be5e75a1a None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:01.664602 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40dd8ea-b8ad-45e2-b73c-462be5e75a1a None admin] PATH_INFO: `/v3/roles` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:01.665443 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40dd8ea-b8ad-45e2-b73c-462be5e75a1a None admin] RBAC: Adding query filter params (name=reader) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:01.665757 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40dd8ea-b8ad-45e2-b73c-462be5e75a1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:01.667166 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40dd8ea-b8ad-45e2-b73c-462be5e75a1a None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:01.687848 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 113/240] 10.222.0.44 () {56 vars in 1101 bytes} [Wed May 25 11:52:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:01.695900 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40dd8ea-b8ad-45e2-b73c-462be5e75a1a None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:01.710471 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:01.712331 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06aabeb-4221-4c5e-ab15-2d1eb14a7227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:01.713300 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06aabeb-4221-4c5e-ab15-2d1eb14a7227 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:01.713710 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06aabeb-4221-4c5e-ab15-2d1eb14a7227 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:01.713994 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06aabeb-4221-4c5e-ab15-2d1eb14a7227 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:01.719490 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06aabeb-4221-4c5e-ab15-2d1eb14a7227 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:01.719490 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06aabeb-4221-4c5e-ab15-2d1eb14a7227 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:01.719861 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 128/241] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:52:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:52:01.727325 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06aabeb-4221-4c5e-ab15-2d1eb14a7227 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:01.843357 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40dd8ea-b8ad-45e2-b73c-462be5e75a1a None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:01.898037 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfefb8f-b465-4b2b-9eb9-210b2e54c8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:01.899436 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfefb8f-b465-4b2b-9eb9-210b2e54c8e8 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:01.901097 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfefb8f-b465-4b2b-9eb9-210b2e54c8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:01.902365 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfefb8f-b465-4b2b-9eb9-210b2e54c8e8 None admin] PATH_INFO: `/v3/users/d420d3d5da0449a4a922830b04be1420` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:01.928193 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfefb8f-b465-4b2b-9eb9-210b2e54c8e8 None admin] RBAC: Authorizing `identity:get_user(user_id=d420d3d5da0449a4a922830b04be1420)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:01.930502 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfefb8f-b465-4b2b-9eb9-210b2e54c8e8 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:01.933420 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06aabeb-4221-4c5e-ab15-2d1eb14a7227 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:01.936778 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 114/242] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 25 11:52:01 2022] GET /identity/v3/users/d420d3d5da0449a4a922830b04be1420 => generated 297 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:01.944145 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfefb8f-b465-4b2b-9eb9-210b2e54c8e8 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:02.022130 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22edd87a-c2be-4472-baaf-515e6afea084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:02.022866 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22edd87a-c2be-4472-baaf-515e6afea084 None admin] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:02.023153 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22edd87a-c2be-4472-baaf-515e6afea084 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:02.023431 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22edd87a-c2be-4472-baaf-515e6afea084 None admin] PATH_INFO: `/v3/users` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:02.024194 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22edd87a-c2be-4472-baaf-515e6afea084 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:02.025659 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22edd87a-c2be-4472-baaf-515e6afea084 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:02.033325 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:02.070369 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 129/243] 10.222.0.44 () {60 vars in 1132 bytes} [Wed May 25 11:52:01 2022] POST /identity/v3/users => generated 293 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 11:52:02.079498 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfefb8f-b465-4b2b-9eb9-210b2e54c8e8 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:02.118672 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba30e2db-340c-44a0-860b-0d2c22314e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:02.119913 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30e2db-340c-44a0-860b-0d2c22314e9b None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:02.120451 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30e2db-340c-44a0-860b-0d2c22314e9b None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:02.120995 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30e2db-340c-44a0-860b-0d2c22314e9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:02.204397 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba30e2db-340c-44a0-860b-0d2c22314e9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:02.206801 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba30e2db-340c-44a0-860b-0d2c22314e9b None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:02.290235 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:02.308853 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70687aa8-f2b5-4a38-b917-5a72ccbb763f None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:02.309390 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70687aa8-f2b5-4a38-b917-5a72ccbb763f None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:02.309390 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70687aa8-f2b5-4a38-b917-5a72ccbb763f None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:02.310770 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 130/244] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:52:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:52:02.317581 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d942238-a01f-4a2c-a9d2-1844f3c70e11 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:02.317865 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d942238-a01f-4a2c-a9d2-1844f3c70e11 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:02.318143 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d942238-a01f-4a2c-a9d2-1844f3c70e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:02.329564 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:02.337850 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 115/245] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 25 11:52:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 11:52:02.338729 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-0d942238-a01f-4a2c-a9d2-1844f3c70e11 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:52:02.341880 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-0d942238-a01f-4a2c-a9d2-1844f3c70e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:52:02.347099 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba30e2db-340c-44a0-860b-0d2c22314e9b None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:02.450773 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 131/246] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:52:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 11:52:02.476371 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d942238-a01f-4a2c-a9d2-1844f3c70e11 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:02.478986 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba30e2db-340c-44a0-860b-0d2c22314e9b None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:02.526059 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6597eed3-5e6d-4274-ac1a-667abb5fb714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:02.528537 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597eed3-5e6d-4274-ac1a-667abb5fb714 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:02.528845 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597eed3-5e6d-4274-ac1a-667abb5fb714 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:02.529125 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597eed3-5e6d-4274-ac1a-667abb5fb714 None admin] PATH_INFO: `/v3/projects/fbdd1a23ea8a4df7ad5aa9fb346fe0da` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:02.531393 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6597eed3-5e6d-4274-ac1a-667abb5fb714 None admin] RBAC: Authorizing `identity:get_project(project_id=fbdd1a23ea8a4df7ad5aa9fb346fe0da)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:02.533113 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6597eed3-5e6d-4274-ac1a-667abb5fb714 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:02.535197 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 116/247] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 25 11:52:02 2022] GET /identity/v3/projects/fbdd1a23ea8a4df7ad5aa9fb346fe0da => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:02.541553 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6597eed3-5e6d-4274-ac1a-667abb5fb714 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:02.595828 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:02.624124 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d942238-a01f-4a2c-a9d2-1844f3c70e11 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:02.674992 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f61728e-525a-4ca6-8186-0af86f416528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:02.676162 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61728e-525a-4ca6-8186-0af86f416528 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:02.676708 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61728e-525a-4ca6-8186-0af86f416528 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:02.677004 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61728e-525a-4ca6-8186-0af86f416528 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:02.679530 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6597eed3-5e6d-4274-ac1a-667abb5fb714 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:02.680036 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:02.694987 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f61728e-525a-4ca6-8186-0af86f416528 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:52:02.704504 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-1f61728e-525a-4ca6-8186-0af86f416528 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 11:52:02.704504 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:02.704504 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:02.704504 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:02.704504 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:02.704504 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:02.704504 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:02.704504 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:02.704504 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:02.704504 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:02.704504 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:02.704504 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:02.704504 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:52:02.704504 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:52:02.704504 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:52:02.704504 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:52:02.705388 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:52:02.705388 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:52:02.705388 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:52:02.705388 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:52:02.705388 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:02.705388 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:02.705388 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:02.705388 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:02.705388 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:02.705388 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:02.705388 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:02.705388 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:52:02.705388 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:02.705388 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:02.705388 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:02.705388 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:02.706187 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:02.706187 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:02.706187 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:02.706187 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:02.706187 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:52:02.706187 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:52:02.706187 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:52:02.706187 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:52:02.706187 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:52:02.706187 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:52:02.706187 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 11:52:02.706187 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:52:02.709201 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 132/248] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 25 11:52:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:02.716801 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f61728e-525a-4ca6-8186-0af86f416528 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:02.722759 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2416e4-a6bb-4450-bbcb-042a98e8c379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:02.723648 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2416e4-a6bb-4450-bbcb-042a98e8c379 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:02.724112 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2416e4-a6bb-4450-bbcb-042a98e8c379 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:02.724533 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2416e4-a6bb-4450-bbcb-042a98e8c379 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:02.725541 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2416e4-a6bb-4450-bbcb-042a98e8c379 None admin] RBAC: Adding query filter params (role.id=038496e26bf34707a6fa4de9bc368de5, scope.project.id=fbdd1a23ea8a4df7ad5aa9fb346fe0da, user.id=d420d3d5da0449a4a922830b04be1420) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:02.726005 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2416e4-a6bb-4450-bbcb-042a98e8c379 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:02.727663 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2416e4-a6bb-4450-bbcb-042a98e8c379 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:02.735349 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 117/249] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 25 11:52:02 2022] GET /identity/v3/role_assignments?user.id=d420d3d5da0449a4a922830b04be1420&scope.project.id=fbdd1a23ea8a4df7ad5aa9fb346fe0da&role.id=038496e26bf34707a6fa4de9bc368de5 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:02.821530 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33026c-9693-4f3f-ad93-41d2d1f3919e None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:02.822074 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33026c-9693-4f3f-ad93-41d2d1f3919e None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:02.822499 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33026c-9693-4f3f-ad93-41d2d1f3919e None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:02.824624 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 118/250] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:52:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 11:52:02.830548 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc49bf-c954-434b-b05f-3981f7328adf None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:02.831106 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc49bf-c954-434b-b05f-3981f7328adf None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:02.831586 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc49bf-c954-434b-b05f-3981f7328adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:02.841696 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f61728e-525a-4ca6-8186-0af86f416528 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:02.864262 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-49fc49bf-c954-434b-b05f-3981f7328adf None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:52:02.866018 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-49fc49bf-c954-434b-b05f-3981f7328adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:52:02.890124 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d386a8b-b320-407c-bec7-5e8056559541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:02.890827 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d386a8b-b320-407c-bec7-5e8056559541 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:02.891120 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d386a8b-b320-407c-bec7-5e8056559541 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:02.891405 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d386a8b-b320-407c-bec7-5e8056559541 None admin] PATH_INFO: `/v3/roles` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:02.892252 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d386a8b-b320-407c-bec7-5e8056559541 None admin] RBAC: Adding query filter params (name=member) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:02.892564 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d386a8b-b320-407c-bec7-5e8056559541 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:02.894108 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d386a8b-b320-407c-bec7-5e8056559541 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:02.905491 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 133/251] 10.222.0.44 () {56 vars in 1101 bytes} [Wed May 25 11:52:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:52:02.916464 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d386a8b-b320-407c-bec7-5e8056559541 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:03.004920 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:03.017154 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 119/252] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:52:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 11:52:03.027831 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4524d-5941-40b6-b1c4-f2d4ecd50bd1 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:03.027831 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4524d-5941-40b6-b1c4-f2d4ecd50bd1 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:03.027831 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4524d-5941-40b6-b1c4-f2d4ecd50bd1 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:03.027831 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 120/253] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:52:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 11:52:03.030220 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45933df8-71ec-462c-b3c7-832b6cc4b6ac None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:03.030220 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45933df8-71ec-462c-b3c7-832b6cc4b6ac None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:03.030403 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45933df8-71ec-462c-b3c7-832b6cc4b6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:03.048608 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-45933df8-71ec-462c-b3c7-832b6cc4b6ac None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:52:03.049805 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-45933df8-71ec-462c-b3c7-832b6cc4b6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:52:03.069260 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d386a8b-b320-407c-bec7-5e8056559541 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:03.071637 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:03.119918 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 121/254] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:52:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 11:52:03.121342 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45933df8-71ec-462c-b3c7-832b6cc4b6ac None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:03.127619 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c13ffb-d6eb-4ab1-a945-a8e7f4d783e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:03.128640 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c13ffb-d6eb-4ab1-a945-a8e7f4d783e4 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:03.128924 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c13ffb-d6eb-4ab1-a945-a8e7f4d783e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:03.129196 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c13ffb-d6eb-4ab1-a945-a8e7f4d783e4 None admin] PATH_INFO: `/v3/users/4c27c50067cb4c8b9f46b4b007e9bd66` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:03.137193 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c13ffb-d6eb-4ab1-a945-a8e7f4d783e4 None admin] RBAC: Authorizing `identity:get_user(user_id=4c27c50067cb4c8b9f46b4b007e9bd66)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:03.138663 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c13ffb-d6eb-4ab1-a945-a8e7f4d783e4 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:03.140840 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 134/255] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 25 11:52:02 2022] GET /identity/v3/users/4c27c50067cb4c8b9f46b4b007e9bd66 => generated 297 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:03.145913 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c13ffb-d6eb-4ab1-a945-a8e7f4d783e4 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:03.250082 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c13ffb-d6eb-4ab1-a945-a8e7f4d783e4 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:03.261987 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45933df8-71ec-462c-b3c7-832b6cc4b6ac None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:03.284465 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d626b9e4-7dae-41db-beee-eec6003067cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:03.285317 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626b9e4-7dae-41db-beee-eec6003067cb None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:03.285593 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626b9e4-7dae-41db-beee-eec6003067cb None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:03.285866 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626b9e4-7dae-41db-beee-eec6003067cb None admin] PATH_INFO: `/v3/projects/fbdd1a23ea8a4df7ad5aa9fb346fe0da` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:03.287065 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d626b9e4-7dae-41db-beee-eec6003067cb None admin] RBAC: Authorizing `identity:get_project(project_id=fbdd1a23ea8a4df7ad5aa9fb346fe0da)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:03.288539 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d626b9e4-7dae-41db-beee-eec6003067cb None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:03.290507 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 135/256] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 25 11:52:03 2022] GET /identity/v3/projects/fbdd1a23ea8a4df7ad5aa9fb346fe0da => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:03.290807 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:03.298487 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d626b9e4-7dae-41db-beee-eec6003067cb None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:03.306452 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c0b7b5-397c-4cd7-907a-9b5238fba45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:03.307649 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0b7b5-397c-4cd7-907a-9b5238fba45a None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:03.308205 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0b7b5-397c-4cd7-907a-9b5238fba45a None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:03.308813 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0b7b5-397c-4cd7-907a-9b5238fba45a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:03.336337 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c0b7b5-397c-4cd7-907a-9b5238fba45a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:52:03.352063 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-17c0b7b5-397c-4cd7-907a-9b5238fba45a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 11:52:03.352063 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:03.352063 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:03.352063 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:03.352063 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:03.352063 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:03.352063 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:03.352063 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:03.352063 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:03.352063 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:03.352063 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:03.352063 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:03.352063 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:52:03.352063 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:52:03.352063 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:52:03.352063 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:52:03.353014 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:52:03.353014 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:52:03.353014 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:52:03.353014 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:52:03.353014 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:03.353014 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:03.353014 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:03.353014 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:03.353014 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:03.353014 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:03.353014 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:03.353014 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:52:03.353014 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:03.353014 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:03.353014 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:03.353014 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:03.353805 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:03.353805 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:03.353805 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:03.353805 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:03.353805 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:52:03.353805 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:52:03.353805 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:52:03.353805 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:52:03.353805 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:52:03.353805 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:52:03.353805 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 11:52:03.353805 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:52:03.353805 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 122/257] 10.222.0.44 () {56 vars in 1096 bytes} [Wed May 25 11:52:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:03.354477 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c0b7b5-397c-4cd7-907a-9b5238fba45a None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:03.420167 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:03.445099 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d626b9e4-7dae-41db-beee-eec6003067cb None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:03.509831 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4b472-cd7d-4c2d-9a5c-63ddc1313261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:03.511000 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4b472-cd7d-4c2d-9a5c-63ddc1313261 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:03.512197 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4b472-cd7d-4c2d-9a5c-63ddc1313261 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:03.512704 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4b472-cd7d-4c2d-9a5c-63ddc1313261 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:03.537623 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c4b472-cd7d-4c2d-9a5c-63ddc1313261 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:52:03.551449 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-69c4b472-cd7d-4c2d-9a5c-63ddc1313261 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 11:52:03.551449 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:03.551449 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:03.551449 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:03.551449 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:03.551449 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:03.551449 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:03.551449 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:03.551449 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:03.551449 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:03.551449 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:03.551449 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:03.551449 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:52:03.551449 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:52:03.551449 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:52:03.551449 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:52:03.552575 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:52:03.552575 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:52:03.552575 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:52:03.552575 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:52:03.552575 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:03.552575 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:03.552575 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:03.552575 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:03.552575 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:03.552575 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:03.552575 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:03.552575 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:52:03.552575 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:03.552575 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:03.552575 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:03.552575 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:03.553363 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:03.553363 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:03.553363 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:03.553363 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:03.553363 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:52:03.553363 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:52:03.553363 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:52:03.553363 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:52:03.553363 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:52:03.553363 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:52:03.553363 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 11:52:03.553363 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:52:03.559224 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 136/258] 10.222.0.44 () {56 vars in 1114 bytes} [Wed May 25 11:52:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:03.560322 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4b472-cd7d-4c2d-9a5c-63ddc1313261 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:03.600002 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c0b7b5-397c-4cd7-907a-9b5238fba45a None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:03.653677 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58717aa1-885c-4e7b-b7d0-8992b32266f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:03.655078 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58717aa1-885c-4e7b-b7d0-8992b32266f6 None admin] REQUEST_METHOD: `PUT` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:03.655571 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58717aa1-885c-4e7b-b7d0-8992b32266f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:03.656229 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58717aa1-885c-4e7b-b7d0-8992b32266f6 None admin] PATH_INFO: `/v3/projects/fbdd1a23ea8a4df7ad5aa9fb346fe0da/users/4c27c50067cb4c8b9f46b4b007e9bd66/roles/0bb7b8a3ae8f4d03a7f575ca8904963c` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:03.659276 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58717aa1-885c-4e7b-b7d0-8992b32266f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=fbdd1a23ea8a4df7ad5aa9fb346fe0da, user_id=4c27c50067cb4c8b9f46b4b007e9bd66, role_id=0bb7b8a3ae8f4d03a7f575ca8904963c)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:03.661035 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58717aa1-885c-4e7b-b7d0-8992b32266f6 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:03.680721 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 123/259] 10.222.0.44 () {58 vars in 1439 bytes} [Wed May 25 11:52:03 2022] PUT /identity/v3/projects/fbdd1a23ea8a4df7ad5aa9fb346fe0da/users/4c27c50067cb4c8b9f46b4b007e9bd66/roles/0bb7b8a3ae8f4d03a7f575ca8904963c => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 11:52:03.684177 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58717aa1-885c-4e7b-b7d0-8992b32266f6 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:03.687935 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:03.757595 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4b472-cd7d-4c2d-9a5c-63ddc1313261 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:03.796334 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109417b-e82e-463d-95e1-9a04555ef3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:03.802480 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109417b-e82e-463d-95e1-9a04555ef3bd None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:03.803239 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109417b-e82e-463d-95e1-9a04555ef3bd None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:03.803772 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109417b-e82e-463d-95e1-9a04555ef3bd None admin] PATH_INFO: `/v3/roles` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:03.804870 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3109417b-e82e-463d-95e1-9a04555ef3bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:03.805395 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3109417b-e82e-463d-95e1-9a04555ef3bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:03.807099 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3109417b-e82e-463d-95e1-9a04555ef3bd None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:03.824199 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 137/260] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 25 11:52:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:03.829875 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109417b-e82e-463d-95e1-9a04555ef3bd None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:03.964154 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:04.002809 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58717aa1-885c-4e7b-b7d0-8992b32266f6 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:04.026731 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109417b-e82e-463d-95e1-9a04555ef3bd None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:04.055521 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:04.063149 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1da313-16cb-4e12-8df5-4d0612089951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:04.063846 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1da313-16cb-4e12-8df5-4d0612089951 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:04.064131 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1da313-16cb-4e12-8df5-4d0612089951 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:04.064403 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1da313-16cb-4e12-8df5-4d0612089951 None admin] PATH_INFO: `/v3/roles` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:04.065152 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1da313-16cb-4e12-8df5-4d0612089951 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:04.065456 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1da313-16cb-4e12-8df5-4d0612089951 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:04.066843 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1da313-16cb-4e12-8df5-4d0612089951 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:04.081338 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 124/261] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 25 11:52:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:04.085961 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a591af-8433-42ab-b885-f2a45fc3b1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:04.087294 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1da313-16cb-4e12-8df5-4d0612089951 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:04.088375 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a591af-8433-42ab-b885-f2a45fc3b1bd None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:04.088651 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a591af-8433-42ab-b885-f2a45fc3b1bd None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:04.088919 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a591af-8433-42ab-b885-f2a45fc3b1bd None admin] PATH_INFO: `/v3/users/34f2136e8d224341a9aba9afb5a5b820` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:04.090994 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a591af-8433-42ab-b885-f2a45fc3b1bd None admin] RBAC: Authorizing `identity:get_user(user_id=34f2136e8d224341a9aba9afb5a5b820)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:04.094321 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a591af-8433-42ab-b885-f2a45fc3b1bd None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:04.097041 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 138/262] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 25 11:52:03 2022] GET /identity/v3/users/34f2136e8d224341a9aba9afb5a5b820 => generated 283 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:52:04.103361 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a591af-8433-42ab-b885-f2a45fc3b1bd None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:04.291856 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1da313-16cb-4e12-8df5-4d0612089951 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:04.302984 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a591af-8433-42ab-b885-f2a45fc3b1bd None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:04.352926 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ea6a3-c7d7-471a-8070-df85f3efecb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:04.353723 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ea6a3-c7d7-471a-8070-df85f3efecb9 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:04.354006 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ea6a3-c7d7-471a-8070-df85f3efecb9 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:04.354282 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ea6a3-c7d7-471a-8070-df85f3efecb9 None admin] PATH_INFO: `/v3/users/34f2136e8d224341a9aba9afb5a5b820` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:04.356331 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818ea6a3-c7d7-471a-8070-df85f3efecb9 None admin] RBAC: Authorizing `identity:get_user(user_id=34f2136e8d224341a9aba9afb5a5b820)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:04.357773 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818ea6a3-c7d7-471a-8070-df85f3efecb9 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:04.361972 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 125/263] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 25 11:52:04 2022] GET /identity/v3/users/34f2136e8d224341a9aba9afb5a5b820 => generated 283 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:04.362603 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb8557-1912-46db-b415-2364f67dbdcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:04.363249 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb8557-1912-46db-b415-2364f67dbdcb None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:04.363530 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb8557-1912-46db-b415-2364f67dbdcb None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:04.363821 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb8557-1912-46db-b415-2364f67dbdcb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:04.367248 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ea6a3-c7d7-471a-8070-df85f3efecb9 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:04.388151 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:04.456416 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:04.477610 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eb8557-1912-46db-b415-2364f67dbdcb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:04.479154 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eb8557-1912-46db-b415-2364f67dbdcb None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:04.500741 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ea6a3-c7d7-471a-8070-df85f3efecb9 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:04.568455 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1845f3-d98d-4b96-bb47-80e4b1c3cf81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:04.569564 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1845f3-d98d-4b96-bb47-80e4b1c3cf81 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:04.570047 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1845f3-d98d-4b96-bb47-80e4b1c3cf81 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:04.570614 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1845f3-d98d-4b96-bb47-80e4b1c3cf81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:04.593272 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 139/264] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 25 11:52:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 11:52:04.600226 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb8557-1912-46db-b415-2364f67dbdcb None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:04.711355 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1845f3-d98d-4b96-bb47-80e4b1c3cf81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:04.712846 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1845f3-d98d-4b96-bb47-80e4b1c3cf81 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:04.729828 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:04.730976 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:04.733279 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb8557-1912-46db-b415-2364f67dbdcb None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:04.772246 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aea6b4-93d0-4698-985d-2b0383071e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:04.773383 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aea6b4-93d0-4698-985d-2b0383071e64 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:04.773667 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aea6b4-93d0-4698-985d-2b0383071e64 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:04.773944 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aea6b4-93d0-4698-985d-2b0383071e64 None admin] PATH_INFO: `/v3/projects/fbdd1a23ea8a4df7ad5aa9fb346fe0da` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:04.775274 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aea6b4-93d0-4698-985d-2b0383071e64 None admin] RBAC: Authorizing `identity:get_project(project_id=fbdd1a23ea8a4df7ad5aa9fb346fe0da)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:04.776901 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aea6b4-93d0-4698-985d-2b0383071e64 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:04.779311 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 140/265] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 25 11:52:04 2022] GET /identity/v3/projects/fbdd1a23ea8a4df7ad5aa9fb346fe0da => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:52:04.785143 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aea6b4-93d0-4698-985d-2b0383071e64 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:04.891490 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aea6b4-93d0-4698-985d-2b0383071e64 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:04.907924 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 126/266] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 25 11:52:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 11:52:04.908839 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1845f3-d98d-4b96-bb47-80e4b1c3cf81 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:04.928220 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e62fef-7744-4da0-bdc6-fb506c658c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:04.928946 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e62fef-7744-4da0-bdc6-fb506c658c33 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:04.929237 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e62fef-7744-4da0-bdc6-fb506c658c33 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:04.929518 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e62fef-7744-4da0-bdc6-fb506c658c33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:04.930347 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e62fef-7744-4da0-bdc6-fb506c658c33 None admin] RBAC: Adding query filter params (role.id=2fe5c1214bcc4c1bafa5a4545161518d, scope.project.id=fbdd1a23ea8a4df7ad5aa9fb346fe0da, user.id=34f2136e8d224341a9aba9afb5a5b820) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:04.930765 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e62fef-7744-4da0-bdc6-fb506c658c33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:04.932393 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e62fef-7744-4da0-bdc6-fb506c658c33 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:04.939397 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 141/267] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 25 11:52:04 2022] GET /identity/v3/role_assignments?user.id=34f2136e8d224341a9aba9afb5a5b820&scope.project.id=fbdd1a23ea8a4df7ad5aa9fb346fe0da&role.id=2fe5c1214bcc4c1bafa5a4545161518d => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:05.091967 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1845f3-d98d-4b96-bb47-80e4b1c3cf81 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:05.103830 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:05.139023 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1bdbcc-93ac-4af1-8e5a-b96e48d58f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:05.139938 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1bdbcc-93ac-4af1-8e5a-b96e48d58f0a None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:05.140240 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1bdbcc-93ac-4af1-8e5a-b96e48d58f0a None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:05.140517 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1bdbcc-93ac-4af1-8e5a-b96e48d58f0a None admin] PATH_INFO: `/v3/projects/fbdd1a23ea8a4df7ad5aa9fb346fe0da` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:05.141721 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1bdbcc-93ac-4af1-8e5a-b96e48d58f0a None admin] RBAC: Authorizing `identity:get_project(project_id=fbdd1a23ea8a4df7ad5aa9fb346fe0da)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:05.143185 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1bdbcc-93ac-4af1-8e5a-b96e48d58f0a None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:05.145613 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 127/268] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 25 11:52:04 2022] GET /identity/v3/projects/fbdd1a23ea8a4df7ad5aa9fb346fe0da => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:05.159197 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e62fef-7744-4da0-bdc6-fb506c658c33 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:05.223827 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:05.319413 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e62fef-7744-4da0-bdc6-fb506c658c33 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:05.356305 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560273ec-4b5d-4551-a4b3-5bf3fa7dbae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:05.356897 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560273ec-4b5d-4551-a4b3-5bf3fa7dbae2 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:05.357181 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560273ec-4b5d-4551-a4b3-5bf3fa7dbae2 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:05.357462 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560273ec-4b5d-4551-a4b3-5bf3fa7dbae2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:05.358306 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560273ec-4b5d-4551-a4b3-5bf3fa7dbae2 None admin] RBAC: Adding query filter params (role.id=1d75537a128747f180972029d0241cb4, scope.project.id=fbdd1a23ea8a4df7ad5aa9fb346fe0da, user.id=34f2136e8d224341a9aba9afb5a5b820) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:05.358620 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560273ec-4b5d-4551-a4b3-5bf3fa7dbae2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:05.360172 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560273ec-4b5d-4551-a4b3-5bf3fa7dbae2 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:05.367000 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 142/269] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 25 11:52:05 2022] GET /identity/v3/role_assignments?user.id=34f2136e8d224341a9aba9afb5a5b820&scope.project.id=fbdd1a23ea8a4df7ad5aa9fb346fe0da&role.id=1d75537a128747f180972029d0241cb4 => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:05.762884 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a01ffe4-2908-40ce-9833-69e69ad80ed8 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:05.763396 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a01ffe4-2908-40ce-9833-69e69ad80ed8 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:05.763470 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a01ffe4-2908-40ce-9833-69e69ad80ed8 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:05.764835 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 128/270] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:52:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:52:05.770119 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb828b2-9b45-4506-87ca-dbb76dc0ad8a None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:05.770551 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb828b2-9b45-4506-87ca-dbb76dc0ad8a None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:05.770724 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb828b2-9b45-4506-87ca-dbb76dc0ad8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:05.791295 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-6cb828b2-9b45-4506-87ca-dbb76dc0ad8a None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:52:05.793071 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-6cb828b2-9b45-4506-87ca-dbb76dc0ad8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:52:05.881332 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 143/271] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:52:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 11:52:05.906918 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a01ffe4-2908-40ce-9833-69e69ad80ed8 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:06.019262 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9763dc83-beda-46ed-a946-681eb5a6c1ef None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:06.019554 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9763dc83-beda-46ed-a946-681eb5a6c1ef None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:06.019743 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9763dc83-beda-46ed-a946-681eb5a6c1ef None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:06.021299 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 144/272] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:52:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:52:06.028952 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69206233-8472-45f9-83ca-a8301a6f3db1 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:06.029496 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69206233-8472-45f9-83ca-a8301a6f3db1 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:06.030009 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69206233-8472-45f9-83ca-a8301a6f3db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:06.049184 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a01ffe4-2908-40ce-9833-69e69ad80ed8 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:06.050206 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-69206233-8472-45f9-83ca-a8301a6f3db1 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:52:06.051636 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-69206233-8472-45f9-83ca-a8301a6f3db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:52:06.060133 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:06.092004 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd02621b-7c22-42ea-891d-1dcec8e750f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:06.092835 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02621b-7c22-42ea-891d-1dcec8e750f8 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:06.093121 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02621b-7c22-42ea-891d-1dcec8e750f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:06.093447 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02621b-7c22-42ea-891d-1dcec8e750f8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:06.103961 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd02621b-7c22-42ea-891d-1dcec8e750f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:52:06.112267 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-fd02621b-7c22-42ea-891d-1dcec8e750f8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 11:52:06.112267 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:06.112267 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:06.112267 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:06.112267 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:06.112267 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:06.112267 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:06.112267 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:06.112267 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:06.112267 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:06.112267 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:06.112267 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:06.112267 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:52:06.112267 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:52:06.112267 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:52:06.112267 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:52:06.113167 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:52:06.113167 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:52:06.113167 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:52:06.113167 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:52:06.113167 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:06.113167 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:06.113167 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:06.113167 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:06.113167 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:06.113167 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:06.113167 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:06.113167 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:52:06.113167 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:06.113167 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:06.113167 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:06.113167 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:06.114032 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:06.114032 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:06.114032 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:06.114032 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:06.114032 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:52:06.114032 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:52:06.114032 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:52:06.114032 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:52:06.114032 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:52:06.114032 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:52:06.114032 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 11:52:06.114032 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:52:06.114032 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 129/273] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 25 11:52:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:06.114906 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30e778-5528-4293-9596-f6746f5d76bb None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:06.115084 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30e778-5528-4293-9596-f6746f5d76bb None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:06.115636 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30e778-5528-4293-9596-f6746f5d76bb None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:06.116646 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 130/274] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:52:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:52:06.121427 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af30e778-5528-4293-9596-f6746f5d76bb None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:06.135319 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 145/275] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:52:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 11:52:06.136719 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6df570-f050-4f71-b858-1b52b5e2491e None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:06.137005 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6df570-f050-4f71-b858-1b52b5e2491e None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:06.137287 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6df570-f050-4f71-b858-1b52b5e2491e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:06.154603 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-6a6df570-f050-4f71-b858-1b52b5e2491e None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:52:06.155782 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-6a6df570-f050-4f71-b858-1b52b5e2491e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:52:06.164521 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:06.232778 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 146/276] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:52:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 11:52:06.233975 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6df570-f050-4f71-b858-1b52b5e2491e None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:06.253173 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af30e778-5528-4293-9596-f6746f5d76bb None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:06.289779 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef138bf-e6b8-437e-b1b7-cf79f7be2329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:06.290745 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef138bf-e6b8-437e-b1b7-cf79f7be2329 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:06.291029 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef138bf-e6b8-437e-b1b7-cf79f7be2329 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:06.291301 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef138bf-e6b8-437e-b1b7-cf79f7be2329 None admin] PATH_INFO: `/v3/roles` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:06.292078 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef138bf-e6b8-437e-b1b7-cf79f7be2329 None admin] RBAC: Adding query filter params (name=member) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:06.292387 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef138bf-e6b8-437e-b1b7-cf79f7be2329 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:06.294317 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef138bf-e6b8-437e-b1b7-cf79f7be2329 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:06.302937 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 131/277] 10.222.0.44 () {56 vars in 1101 bytes} [Wed May 25 11:52:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:06.303556 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef138bf-e6b8-437e-b1b7-cf79f7be2329 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:06.313793 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:06.347783 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6df570-f050-4f71-b858-1b52b5e2491e None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:06.391302 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e50c5c-3b7e-4dce-a03d-f9337e1b0d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:06.392125 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e50c5c-3b7e-4dce-a03d-f9337e1b0d25 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:06.392406 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e50c5c-3b7e-4dce-a03d-f9337e1b0d25 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:06.392680 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e50c5c-3b7e-4dce-a03d-f9337e1b0d25 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:06.393924 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e50c5c-3b7e-4dce-a03d-f9337e1b0d25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:06.395835 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e50c5c-3b7e-4dce-a03d-f9337e1b0d25 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:06.397716 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 147/278] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:52:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:06.403098 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e50c5c-3b7e-4dce-a03d-f9337e1b0d25 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:06.406582 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:06.413446 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef138bf-e6b8-437e-b1b7-cf79f7be2329 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:06.450462 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a0f106-9761-491a-83c0-87afd45195d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:06.451387 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a0f106-9761-491a-83c0-87afd45195d8 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:06.451681 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a0f106-9761-491a-83c0-87afd45195d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:06.452128 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a0f106-9761-491a-83c0-87afd45195d8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:06.462410 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a0f106-9761-491a-83c0-87afd45195d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:52:06.471897 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-60a0f106-9761-491a-83c0-87afd45195d8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 11:52:06.471897 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:06.471897 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:06.471897 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:06.471897 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:06.471897 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:06.471897 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:06.471897 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:06.471897 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:06.471897 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:06.471897 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:06.471897 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:06.471897 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:52:06.471897 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:52:06.471897 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:52:06.471897 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:52:06.472929 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:52:06.472929 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:52:06.472929 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:52:06.472929 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:52:06.472929 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:06.472929 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:06.472929 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:06.472929 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:06.472929 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:06.472929 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:06.472929 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:06.472929 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:52:06.472929 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:06.472929 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:06.472929 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:06.472929 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:06.473872 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:06.473872 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:06.473872 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:06.473872 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:06.473872 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:52:06.473872 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:52:06.473872 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:52:06.473872 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:52:06.473872 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:52:06.473872 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:52:06.473872 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 11:52:06.473872 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:52:06.476105 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 132/279] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 25 11:52:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:06.477016 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a0f106-9761-491a-83c0-87afd45195d8 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:06.512948 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e50c5c-3b7e-4dce-a03d-f9337e1b0d25 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:06.548630 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb0e518-8d17-4f4d-a567-02020b62589b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:06.549424 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0e518-8d17-4f4d-a567-02020b62589b None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:06.549708 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0e518-8d17-4f4d-a567-02020b62589b None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:06.549982 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0e518-8d17-4f4d-a567-02020b62589b None admin] PATH_INFO: `/v3/users/c86e0357726f490cb67fbbe326166392` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:06.557692 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:06.565458 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb0e518-8d17-4f4d-a567-02020b62589b None admin] RBAC: Authorizing `identity:get_user(user_id=c86e0357726f490cb67fbbe326166392)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:06.566929 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb0e518-8d17-4f4d-a567-02020b62589b None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:06.568662 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 148/280] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 25 11:52:06 2022] GET /identity/v3/users/c86e0357726f490cb67fbbe326166392 => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:06.569433 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb0e518-8d17-4f4d-a567-02020b62589b None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:06.587524 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a0f106-9761-491a-83c0-87afd45195d8 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:06.624407 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfe21cb-6ad1-45b7-b8cc-cfd054f93a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:06.625206 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe21cb-6ad1-45b7-b8cc-cfd054f93a47 None admin] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:06.625492 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe21cb-6ad1-45b7-b8cc-cfd054f93a47 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:06.625770 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe21cb-6ad1-45b7-b8cc-cfd054f93a47 None admin] PATH_INFO: `/v3/users` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:06.626481 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfe21cb-6ad1-45b7-b8cc-cfd054f93a47 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:06.628238 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfe21cb-6ad1-45b7-b8cc-cfd054f93a47 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:06.653727 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 133/281] 10.222.0.44 () {60 vars in 1132 bytes} [Wed May 25 11:52:06 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 11:52:06.654562 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfe21cb-6ad1-45b7-b8cc-cfd054f93a47 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:06.674909 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:06.701984 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb0e518-8d17-4f4d-a567-02020b62589b None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:06.742819 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4779e-6fcf-43bd-9836-b0f4a2e82736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:06.744105 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4779e-6fcf-43bd-9836-b0f4a2e82736 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:06.744668 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4779e-6fcf-43bd-9836-b0f4a2e82736 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:06.745149 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4779e-6fcf-43bd-9836-b0f4a2e82736 None admin] PATH_INFO: `/v3/roles` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:06.746772 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf4779e-6fcf-43bd-9836-b0f4a2e82736 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:06.747284 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf4779e-6fcf-43bd-9836-b0f4a2e82736 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:06.748943 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf4779e-6fcf-43bd-9836-b0f4a2e82736 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:06.759762 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 149/282] 10.222.0.44 () {56 vars in 1101 bytes} [Wed May 25 11:52:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:06.767958 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4779e-6fcf-43bd-9836-b0f4a2e82736 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:06.804727 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfe21cb-6ad1-45b7-b8cc-cfd054f93a47 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:06.838898 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:06.859400 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b35a6-a319-414a-b40d-deff5276a617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:06.860114 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b35a6-a319-414a-b40d-deff5276a617 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:06.860403 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b35a6-a319-414a-b40d-deff5276a617 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:06.860685 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b35a6-a319-414a-b40d-deff5276a617 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:06.861556 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376b35a6-a319-414a-b40d-deff5276a617 None admin] RBAC: Adding query filter params (role.id=0bb7b8a3ae8f4d03a7f575ca8904963c, user.id=c86e0357726f490cb67fbbe326166392, scope.system=all) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:06.862267 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376b35a6-a319-414a-b40d-deff5276a617 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:06.863350 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376b35a6-a319-414a-b40d-deff5276a617 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:06.869172 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 134/283] 10.222.0.44 () {56 vars in 1308 bytes} [Wed May 25 11:52:06 2022] GET /identity/v3/role_assignments?user.id=c86e0357726f490cb67fbbe326166392&scope.system=all&role.id=0bb7b8a3ae8f4d03a7f575ca8904963c => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:06.892429 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4779e-6fcf-43bd-9836-b0f4a2e82736 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:06.931691 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea6e8c-e04f-4921-90b9-c34ce33ee811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:06.932850 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea6e8c-e04f-4921-90b9-c34ce33ee811 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:06.933768 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea6e8c-e04f-4921-90b9-c34ce33ee811 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:06.934147 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea6e8c-e04f-4921-90b9-c34ce33ee811 None admin] PATH_INFO: `/v3/users/d420d3d5da0449a4a922830b04be1420` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:06.935665 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abea6e8c-e04f-4921-90b9-c34ce33ee811 None admin] RBAC: Authorizing `identity:get_user(user_id=d420d3d5da0449a4a922830b04be1420)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:06.937431 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abea6e8c-e04f-4921-90b9-c34ce33ee811 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:06.939547 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 150/284] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 25 11:52:06 2022] GET /identity/v3/users/d420d3d5da0449a4a922830b04be1420 => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:52:06.944926 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b35a6-a319-414a-b40d-deff5276a617 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:07.005941 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8f0f5-cab1-4a4a-a689-91f92ca2006e None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:07.006337 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8f0f5-cab1-4a4a-a689-91f92ca2006e None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:07.006729 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8f0f5-cab1-4a4a-a689-91f92ca2006e None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:07.010002 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 151/285] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:52:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 11:52:07.016478 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0fe8e-fa7a-4564-bcdb-805e6a055628 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:07.016867 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0fe8e-fa7a-4564-bcdb-805e6a055628 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:07.017214 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0fe8e-fa7a-4564-bcdb-805e6a055628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:07.040345 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:07.042631 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-f6f0fe8e-fa7a-4564-bcdb-805e6a055628 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:52:07.044242 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-f6f0fe8e-fa7a-4564-bcdb-805e6a055628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:52:07.072082 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b35a6-a319-414a-b40d-deff5276a617 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:07.114140 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5457ebef-f8e7-4402-b142-34c2c8f54c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:07.115455 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5457ebef-f8e7-4402-b142-34c2c8f54c3a None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:07.115932 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5457ebef-f8e7-4402-b142-34c2c8f54c3a None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:07.116219 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5457ebef-f8e7-4402-b142-34c2c8f54c3a None admin] PATH_INFO: `/v3/projects/fbdd1a23ea8a4df7ad5aa9fb346fe0da` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:07.117421 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5457ebef-f8e7-4402-b142-34c2c8f54c3a None admin] RBAC: Authorizing `identity:get_project(project_id=fbdd1a23ea8a4df7ad5aa9fb346fe0da)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:07.118917 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5457ebef-f8e7-4402-b142-34c2c8f54c3a None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:07.121475 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 135/286] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 25 11:52:06 2022] GET /identity/v3/projects/fbdd1a23ea8a4df7ad5aa9fb346fe0da => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:07.126972 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5457ebef-f8e7-4402-b142-34c2c8f54c3a None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:07.129392 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 152/287] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:52:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 11:52:07.154743 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f0fe8e-fa7a-4564-bcdb-805e6a055628 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:07.229587 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:07.249364 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5457ebef-f8e7-4402-b142-34c2c8f54c3a None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:07.277709 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f0fe8e-fa7a-4564-bcdb-805e6a055628 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:07.286902 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea55dd-007c-4e2a-adaf-b2d545e112d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:07.288047 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea55dd-007c-4e2a-adaf-b2d545e112d5 None admin] REQUEST_METHOD: `PUT` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:07.288586 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea55dd-007c-4e2a-adaf-b2d545e112d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:07.289013 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea55dd-007c-4e2a-adaf-b2d545e112d5 None admin] PATH_INFO: `/v3/projects/fbdd1a23ea8a4df7ad5aa9fb346fe0da/users/d420d3d5da0449a4a922830b04be1420/roles/038496e26bf34707a6fa4de9bc368de5` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:07.291423 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ea55dd-007c-4e2a-adaf-b2d545e112d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=fbdd1a23ea8a4df7ad5aa9fb346fe0da, user_id=d420d3d5da0449a4a922830b04be1420, role_id=038496e26bf34707a6fa4de9bc368de5)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:07.293736 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ea55dd-007c-4e2a-adaf-b2d545e112d5 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:07.310843 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 136/288] 10.222.0.44 () {58 vars in 1439 bytes} [Wed May 25 11:52:07 2022] PUT /identity/v3/projects/fbdd1a23ea8a4df7ad5aa9fb346fe0da/users/d420d3d5da0449a4a922830b04be1420/roles/038496e26bf34707a6fa4de9bc368de5 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 11:52:07.316972 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d8f32-0439-472f-8056-c8e70de91450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:07.317845 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d8f32-0439-472f-8056-c8e70de91450 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:07.318236 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d8f32-0439-472f-8056-c8e70de91450 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:07.318513 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d8f32-0439-472f-8056-c8e70de91450 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:07.332135 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6d8f32-0439-472f-8056-c8e70de91450 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:52:07.341841 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-ee6d8f32-0439-472f-8056-c8e70de91450 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 11:52:07.341841 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:07.341841 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:07.341841 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:07.341841 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:07.341841 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:07.341841 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:07.341841 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:07.341841 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:07.341841 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:07.341841 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:07.341841 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:07.341841 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:52:07.341841 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:52:07.341841 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:52:07.341841 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:52:07.342826 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:52:07.342826 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:52:07.342826 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:52:07.342826 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:52:07.342826 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:07.342826 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:07.342826 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:07.342826 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:07.342826 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:07.342826 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:07.342826 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:07.342826 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:52:07.342826 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:07.342826 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:07.342826 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:07.342826 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:07.343612 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:07.343612 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:07.343612 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:07.343612 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:07.343612 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:52:07.343612 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:52:07.343612 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:52:07.343612 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:52:07.343612 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:52:07.343612 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:52:07.343612 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 11:52:07.343612 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:52:07.343612 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 153/289] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 25 11:52:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:07.349750 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea55dd-007c-4e2a-adaf-b2d545e112d5 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:07.354737 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:07.469708 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea55dd-007c-4e2a-adaf-b2d545e112d5 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:07.507188 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a84e2f-abdd-4fc2-8881-179a4faab8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:07.508291 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a84e2f-abdd-4fc2-8881-179a4faab8b3 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:07.508808 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a84e2f-abdd-4fc2-8881-179a4faab8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:07.509287 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a84e2f-abdd-4fc2-8881-179a4faab8b3 None admin] PATH_INFO: `/v3/roles` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:07.510279 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a84e2f-abdd-4fc2-8881-179a4faab8b3 None admin] RBAC: Adding query filter params (name=member) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:07.510791 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a84e2f-abdd-4fc2-8881-179a4faab8b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:07.512524 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a84e2f-abdd-4fc2-8881-179a4faab8b3 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:07.522149 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 137/290] 10.222.0.44 () {56 vars in 1101 bytes} [Wed May 25 11:52:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:07.528774 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d8f32-0439-472f-8056-c8e70de91450 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:07.650753 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d8f32-0439-472f-8056-c8e70de91450 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:07.673698 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:07.693153 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ce6fd-9879-464b-990d-6bbc545b0f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:07.694091 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ce6fd-9879-464b-990d-6bbc545b0f00 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:07.694378 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ce6fd-9879-464b-990d-6bbc545b0f00 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:07.694656 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ce6fd-9879-464b-990d-6bbc545b0f00 None admin] PATH_INFO: `/v3/users/4c27c50067cb4c8b9f46b4b007e9bd66` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:07.695934 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ce6fd-9879-464b-990d-6bbc545b0f00 None admin] RBAC: Authorizing `identity:get_user(user_id=4c27c50067cb4c8b9f46b4b007e9bd66)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:07.697385 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ce6fd-9879-464b-990d-6bbc545b0f00 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:07.703594 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 154/291] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 25 11:52:07 2022] GET /identity/v3/users/4c27c50067cb4c8b9f46b4b007e9bd66 => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:07.705099 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a84e2f-abdd-4fc2-8881-179a4faab8b3 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:07.785422 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:07.832693 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a84e2f-abdd-4fc2-8881-179a4faab8b3 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:07.882902 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d6d15-4a00-4d41-b026-5c467edc03b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:07.883560 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d6d15-4a00-4d41-b026-5c467edc03b9 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:07.883870 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d6d15-4a00-4d41-b026-5c467edc03b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:07.884156 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d6d15-4a00-4d41-b026-5c467edc03b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:07.960024 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68d6d15-4a00-4d41-b026-5c467edc03b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:07.961425 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68d6d15-4a00-4d41-b026-5c467edc03b9 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:08.042388 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:08.086490 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 138/292] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 25 11:52:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 11:52:08.092870 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ce6fd-9879-464b-990d-6bbc545b0f00 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:08.204134 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ce6fd-9879-464b-990d-6bbc545b0f00 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:08.243535 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278b835f-639d-4812-9424-cebd15142769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:08.244401 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b835f-639d-4812-9424-cebd15142769 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:08.244727 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b835f-639d-4812-9424-cebd15142769 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:08.245017 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b835f-639d-4812-9424-cebd15142769 None admin] PATH_INFO: `/v3/projects/fbdd1a23ea8a4df7ad5aa9fb346fe0da` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:08.246266 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278b835f-639d-4812-9424-cebd15142769 None admin] RBAC: Authorizing `identity:get_project(project_id=fbdd1a23ea8a4df7ad5aa9fb346fe0da)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:08.247711 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278b835f-639d-4812-9424-cebd15142769 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:08.254333 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 155/293] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 25 11:52:08 2022] GET /identity/v3/projects/fbdd1a23ea8a4df7ad5aa9fb346fe0da => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:08.255683 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d6d15-4a00-4d41-b026-5c467edc03b9 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:08.383634 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d6d15-4a00-4d41-b026-5c467edc03b9 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:08.426310 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5600fd0-3b71-4456-9940-eff4cc62b212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:08.426970 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5600fd0-3b71-4456-9940-eff4cc62b212 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:08.427256 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5600fd0-3b71-4456-9940-eff4cc62b212 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:08.427536 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5600fd0-3b71-4456-9940-eff4cc62b212 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:08.428389 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5600fd0-3b71-4456-9940-eff4cc62b212 None admin] RBAC: Adding query filter params (role.id=0bb7b8a3ae8f4d03a7f575ca8904963c, scope.project.id=fbdd1a23ea8a4df7ad5aa9fb346fe0da, user.id=4c27c50067cb4c8b9f46b4b007e9bd66) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:08.428705 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5600fd0-3b71-4456-9940-eff4cc62b212 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:08.430152 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5600fd0-3b71-4456-9940-eff4cc62b212 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:08.440433 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 139/294] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 25 11:52:08 2022] GET /identity/v3/role_assignments?user.id=4c27c50067cb4c8b9f46b4b007e9bd66&scope.project.id=fbdd1a23ea8a4df7ad5aa9fb346fe0da&role.id=0bb7b8a3ae8f4d03a7f575ca8904963c => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:09.485008 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9a535-a0e7-4442-b38c-5cd9aaa76077 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:09.485499 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9a535-a0e7-4442-b38c-5cd9aaa76077 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:09.485499 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9a535-a0e7-4442-b38c-5cd9aaa76077 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:09.487076 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 156/295] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:52:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:52:09.492479 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb3dd7-74cb-4aa1-85f3-b05eb1ffb223 None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:09.492891 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb3dd7-74cb-4aa1-85f3-b05eb1ffb223 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:09.493078 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb3dd7-74cb-4aa1-85f3-b05eb1ffb223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:09.509762 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-64fb3dd7-74cb-4aa1-85f3-b05eb1ffb223 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:52:09.510962 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-64fb3dd7-74cb-4aa1-85f3-b05eb1ffb223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:52:09.536497 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:09.567711 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc3539-8ed8-4082-a162-482fd8db7ca1 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:09.568106 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc3539-8ed8-4082-a162-482fd8db7ca1 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:09.568388 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc3539-8ed8-4082-a162-482fd8db7ca1 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:09.569885 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 157/296] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:52:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:52:09.577346 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219183b-6845-4938-816a-499560741d57 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:09.577711 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219183b-6845-4938-816a-499560741d57 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:09.578086 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219183b-6845-4938-816a-499560741d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:09.588463 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 140/297] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:52:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 11:52:09.596831 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-0219183b-6845-4938-816a-499560741d57 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:52:09.598154 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-0219183b-6845-4938-816a-499560741d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:52:09.615628 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb3dd7-74cb-4aa1-85f3-b05eb1ffb223 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:09.659932 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:09.690661 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 158/298] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:52:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 11:52:09.713682 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0219183b-6845-4938-816a-499560741d57 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:09.731691 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb3dd7-74cb-4aa1-85f3-b05eb1ffb223 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:09.772926 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a197ab-a717-4922-8211-3c2e7b4785d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:09.773649 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a197ab-a717-4922-8211-3c2e7b4785d5 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:09.773931 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a197ab-a717-4922-8211-3c2e7b4785d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:09.774204 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a197ab-a717-4922-8211-3c2e7b4785d5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:09.790606 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a197ab-a717-4922-8211-3c2e7b4785d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:52:09.800309 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-16a197ab-a717-4922-8211-3c2e7b4785d5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 11:52:09.800309 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:09.800309 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:09.800309 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:09.800309 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:09.800309 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:09.800309 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:09.800309 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:09.800309 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:09.800309 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:09.800309 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:09.800309 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:09.800309 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:52:09.800309 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:52:09.800309 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:52:09.800309 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:52:09.801235 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:52:09.801235 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:52:09.801235 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:52:09.801235 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:52:09.801235 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:09.801235 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:09.801235 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:09.801235 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:09.801235 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:09.801235 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:09.801235 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:09.801235 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:52:09.801235 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:09.801235 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:09.801235 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:09.801235 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:09.802043 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:09.802043 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:09.802043 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:09.802043 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:09.802043 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:52:09.802043 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:52:09.802043 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:52:09.802043 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:52:09.802043 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:52:09.802043 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:52:09.802043 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 11:52:09.802043 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:52:09.802043 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 141/299] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 25 11:52:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 11:52:09.802799 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a69c84-0340-44ce-b76d-1e0e6fc114f0 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:09.803091 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a69c84-0340-44ce-b76d-1e0e6fc114f0 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:09.803373 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a69c84-0340-44ce-b76d-1e0e6fc114f0 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:09.804775 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 142/300] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:52:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:52:09.806859 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a69c84-0340-44ce-b76d-1e0e6fc114f0 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:09.835174 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:09.837787 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0219183b-6845-4938-816a-499560741d57 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:09.888875 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b87e5f4-8f7d-4918-ba56-2f650e6f01d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:09.890323 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87e5f4-8f7d-4918-ba56-2f650e6f01d3 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:09.891260 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87e5f4-8f7d-4918-ba56-2f650e6f01d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:09.892037 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87e5f4-8f7d-4918-ba56-2f650e6f01d3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:09.908367 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b87e5f4-8f7d-4918-ba56-2f650e6f01d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:52:09.918909 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-3b87e5f4-8f7d-4918-ba56-2f650e6f01d3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 11:52:09.918909 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:09.918909 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:09.918909 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:09.918909 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:09.918909 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:09.918909 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:09.918909 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:09.918909 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:09.918909 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:09.918909 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:09.918909 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:09.918909 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:52:09.918909 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:52:09.918909 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:52:09.918909 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:52:09.920718 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:52:09.920718 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:52:09.920718 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:52:09.920718 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:52:09.920718 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:09.920718 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:09.920718 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:09.920718 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:09.920718 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:09.920718 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:09.920718 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:09.920718 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:52:09.920718 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:09.920718 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:09.920718 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:09.920718 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:09.922254 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:09.922254 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:09.922254 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:09.922254 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:09.922254 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:52:09.922254 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:52:09.922254 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:52:09.922254 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:52:09.922254 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:52:09.922254 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:52:09.922254 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 11:52:09.922254 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:52:09.924907 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 159/301] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 25 11:52:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:09.925826 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d8774-25a8-4535-af80-c75c96994e00 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:09.926084 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d8774-25a8-4535-af80-c75c96994e00 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:09.926476 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d8774-25a8-4535-af80-c75c96994e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:09.943105 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a69c84-0340-44ce-b76d-1e0e6fc114f0 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:09.944406 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-238d8774-25a8-4535-af80-c75c96994e00 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:52:09.945599 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-238d8774-25a8-4535-af80-c75c96994e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:52:09.987424 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:09.990839 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd6388c-b01c-442c-aad1-a2e8d01237e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:09.990839 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd6388c-b01c-442c-aad1-a2e8d01237e0 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:09.990839 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd6388c-b01c-442c-aad1-a2e8d01237e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:09.991147 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd6388c-b01c-442c-aad1-a2e8d01237e0 None admin] PATH_INFO: `/v3/roles` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:09.992649 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd6388c-b01c-442c-aad1-a2e8d01237e0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:09.992649 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd6388c-b01c-442c-aad1-a2e8d01237e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:09.995356 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd6388c-b01c-442c-aad1-a2e8d01237e0 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:10.008131 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 143/302] 10.222.0.44 () {56 vars in 1101 bytes} [Wed May 25 11:52:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:52:10.008527 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd6388c-b01c-442c-aad1-a2e8d01237e0 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:10.029632 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 160/303] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:52:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 11:52:10.039804 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238d8774-25a8-4535-af80-c75c96994e00 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:10.097536 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:10.119194 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd6388c-b01c-442c-aad1-a2e8d01237e0 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:10.154850 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238d8774-25a8-4535-af80-c75c96994e00 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:10.159233 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d4d3e0-3c59-4f22-8341-006451cb2f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:10.159937 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4d3e0-3c59-4f22-8341-006451cb2f6e None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:10.160225 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4d3e0-3c59-4f22-8341-006451cb2f6e None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:10.160505 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4d3e0-3c59-4f22-8341-006451cb2f6e None admin] PATH_INFO: `/v3/roles` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:10.161261 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d4d3e0-3c59-4f22-8341-006451cb2f6e None admin] RBAC: Adding query filter params (name=member) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:10.161576 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d4d3e0-3c59-4f22-8341-006451cb2f6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:10.163130 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d4d3e0-3c59-4f22-8341-006451cb2f6e None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:10.174196 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 144/304] 10.222.0.44 () {56 vars in 1101 bytes} [Wed May 25 11:52:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:10.174818 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d4d3e0-3c59-4f22-8341-006451cb2f6e None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:10.200837 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee76a22-430b-40d7-8ed4-7fdf6fc8a09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:10.201832 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee76a22-430b-40d7-8ed4-7fdf6fc8a09f None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:10.202113 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee76a22-430b-40d7-8ed4-7fdf6fc8a09f None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:10.202386 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee76a22-430b-40d7-8ed4-7fdf6fc8a09f None admin] PATH_INFO: `/v3/users/9f01f513f8504c368c4e3ee1bd9567e2` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:10.217511 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee76a22-430b-40d7-8ed4-7fdf6fc8a09f None admin] RBAC: Authorizing `identity:get_user(user_id=9f01f513f8504c368c4e3ee1bd9567e2)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:10.218974 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee76a22-430b-40d7-8ed4-7fdf6fc8a09f None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:10.220877 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 161/305] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 25 11:52:10 2022] GET /identity/v3/users/9f01f513f8504c368c4e3ee1bd9567e2 => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:10.221572 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee76a22-430b-40d7-8ed4-7fdf6fc8a09f None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:10.252422 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:10.283893 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d4d3e0-3c59-4f22-8341-006451cb2f6e None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:10.318964 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16545592-1fb0-48c0-95ec-6b3f941ab1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:10.319759 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16545592-1fb0-48c0-95ec-6b3f941ab1e2 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:10.320074 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16545592-1fb0-48c0-95ec-6b3f941ab1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:10.320358 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16545592-1fb0-48c0-95ec-6b3f941ab1e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:10.321528 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16545592-1fb0-48c0-95ec-6b3f941ab1e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:10.322417 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee76a22-430b-40d7-8ed4-7fdf6fc8a09f None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:10.322985 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16545592-1fb0-48c0-95ec-6b3f941ab1e2 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:10.325039 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 145/306] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:52:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:10.326120 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16545592-1fb0-48c0-95ec-6b3f941ab1e2 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:10.340975 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:10.356971 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d309f90-1af3-4cfc-a655-47f340706e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:10.357767 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d309f90-1af3-4cfc-a655-47f340706e60 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:10.358050 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d309f90-1af3-4cfc-a655-47f340706e60 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:10.358324 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d309f90-1af3-4cfc-a655-47f340706e60 None admin] PATH_INFO: `/v3/users/c86e0357726f490cb67fbbe326166392` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:10.359502 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d309f90-1af3-4cfc-a655-47f340706e60 None admin] RBAC: Authorizing `identity:get_user(user_id=c86e0357726f490cb67fbbe326166392)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:10.360999 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d309f90-1af3-4cfc-a655-47f340706e60 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:10.362605 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 162/307] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 25 11:52:10 2022] GET /identity/v3/users/c86e0357726f490cb67fbbe326166392 => generated 293 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:10.363864 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790376f2-fbde-4265-b8c4-51b2cd6ef466 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:10.364160 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790376f2-fbde-4265-b8c4-51b2cd6ef466 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:10.364432 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790376f2-fbde-4265-b8c4-51b2cd6ef466 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:10.365864 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 163/308] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:52:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:52:10.366468 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790376f2-fbde-4265-b8c4-51b2cd6ef466 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:10.425953 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16545592-1fb0-48c0-95ec-6b3f941ab1e2 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:10.459211 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac4889-b4af-4e72-9831-9f0b9cafbcca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:10.459901 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac4889-b4af-4e72-9831-9f0b9cafbcca None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:10.460188 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac4889-b4af-4e72-9831-9f0b9cafbcca None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:10.460474 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac4889-b4af-4e72-9831-9f0b9cafbcca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:10.461292 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ac4889-b4af-4e72-9831-9f0b9cafbcca None admin] RBAC: Adding query filter params (role.id=038496e26bf34707a6fa4de9bc368de5, user.id=9f01f513f8504c368c4e3ee1bd9567e2, scope.system=all) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:10.461608 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ac4889-b4af-4e72-9831-9f0b9cafbcca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:10.462692 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:10.463343 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ac4889-b4af-4e72-9831-9f0b9cafbcca None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:10.468294 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790376f2-fbde-4265-b8c4-51b2cd6ef466 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:10.468622 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 146/309] 10.222.0.44 () {56 vars in 1308 bytes} [Wed May 25 11:52:10 2022] GET /identity/v3/role_assignments?user.id=9f01f513f8504c368c4e3ee1bd9567e2&scope.system=all&role.id=038496e26bf34707a6fa4de9bc368de5 => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:10.469382 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac4889-b4af-4e72-9831-9f0b9cafbcca None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:10.511047 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eccd425-3642-453c-8bd9-01dff72590a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:10.512070 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eccd425-3642-453c-8bd9-01dff72590a7 None admin] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:10.512385 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eccd425-3642-453c-8bd9-01dff72590a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:10.512640 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eccd425-3642-453c-8bd9-01dff72590a7 None admin] PATH_INFO: `/v3/groups` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:10.513346 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eccd425-3642-453c-8bd9-01dff72590a7 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:10.515854 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eccd425-3642-453c-8bd9-01dff72590a7 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:10.533086 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 164/310] 10.222.0.44 () {60 vars in 1134 bytes} [Wed May 25 11:52:10 2022] POST /identity/v3/groups => generated 229 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 11:52:10.534547 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402d416-749d-481a-a256-9cc3320cf3a5 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:10.534771 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402d416-749d-481a-a256-9cc3320cf3a5 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:10.535056 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402d416-749d-481a-a256-9cc3320cf3a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:10.563727 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-2402d416-749d-481a-a256-9cc3320cf3a5 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:52:10.566064 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-2402d416-749d-481a-a256-9cc3320cf3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:52:10.573563 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:10.603865 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac4889-b4af-4e72-9831-9f0b9cafbcca None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:10.650320 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6399d0cc-3142-41a8-879a-19051202bad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:10.651216 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399d0cc-3142-41a8-879a-19051202bad3 None admin] REQUEST_METHOD: `PUT` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:10.651506 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399d0cc-3142-41a8-879a-19051202bad3 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:10.652352 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399d0cc-3142-41a8-879a-19051202bad3 None admin] PATH_INFO: `/v3/system/users/c86e0357726f490cb67fbbe326166392/roles/0bb7b8a3ae8f4d03a7f575ca8904963c` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:10.654006 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6399d0cc-3142-41a8-879a-19051202bad3 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c86e0357726f490cb67fbbe326166392, role_id=0bb7b8a3ae8f4d03a7f575ca8904963c)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:10.655429 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6399d0cc-3142-41a8-879a-19051202bad3 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:10.661773 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 165/311] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:52:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 11:52:10.670147 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 147/312] 10.222.0.44 () {58 vars in 1334 bytes} [Wed May 25 11:52:10 2022] PUT /identity/v3/system/users/c86e0357726f490cb67fbbe326166392/roles/0bb7b8a3ae8f4d03a7f575ca8904963c => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 11:52:10.692998 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2402d416-749d-481a-a256-9cc3320cf3a5 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:10.801551 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:10.817252 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2402d416-749d-481a-a256-9cc3320cf3a5 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:10.865478 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a83fee-febe-4b74-801b-3aeebfa9f4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:10.866284 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a83fee-febe-4b74-801b-3aeebfa9f4b5 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:10.866570 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a83fee-febe-4b74-801b-3aeebfa9f4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:10.866847 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a83fee-febe-4b74-801b-3aeebfa9f4b5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:10.877856 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a83fee-febe-4b74-801b-3aeebfa9f4b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:52:10.885741 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-90a83fee-febe-4b74-801b-3aeebfa9f4b5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 11:52:10.885741 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:10.885741 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:10.885741 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:10.885741 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:10.885741 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:10.885741 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:10.885741 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:10.885741 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:10.885741 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:10.885741 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:10.885741 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:10.885741 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:52:10.885741 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:52:10.885741 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:52:10.885741 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:52:10.887152 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:52:10.887152 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:52:10.887152 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:52:10.887152 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:52:10.887152 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:10.887152 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:10.887152 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:10.887152 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:10.887152 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:10.887152 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:10.887152 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:10.887152 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:52:10.887152 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:10.887152 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:10.887152 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:10.887152 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:10.888396 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:10.888396 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:10.888396 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:10.888396 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:10.888396 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:52:10.888396 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:52:10.888396 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:52:10.888396 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:52:10.888396 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:52:10.888396 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:52:10.888396 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 11:52:10.888396 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:52:10.888396 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 166/313] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 25 11:52:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:10.893335 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6399d0cc-3142-41a8-879a-19051202bad3 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:11.005802 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6399d0cc-3142-41a8-879a-19051202bad3 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:11.042092 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc77316-e731-4ef4-831e-77049a237589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:11.043660 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc77316-e731-4ef4-831e-77049a237589 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:11.044165 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc77316-e731-4ef4-831e-77049a237589 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:11.044643 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc77316-e731-4ef4-831e-77049a237589 None admin] PATH_INFO: `/v3/roles` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:11.045641 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc77316-e731-4ef4-831e-77049a237589 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:11.046162 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc77316-e731-4ef4-831e-77049a237589 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:11.047784 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc77316-e731-4ef4-831e-77049a237589 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:11.057298 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 148/314] 10.222.0.44 () {56 vars in 1101 bytes} [Wed May 25 11:52:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:11.062996 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a83fee-febe-4b74-801b-3aeebfa9f4b5 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:11.174831 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a83fee-febe-4b74-801b-3aeebfa9f4b5 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:11.211230 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a99505-19c2-499d-9423-f4e6ca962b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:11.212135 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a99505-19c2-499d-9423-f4e6ca962b11 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:11.212417 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a99505-19c2-499d-9423-f4e6ca962b11 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:11.212688 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a99505-19c2-499d-9423-f4e6ca962b11 None admin] PATH_INFO: `/v3/users/d420d3d5da0449a4a922830b04be1420` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:11.213883 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a99505-19c2-499d-9423-f4e6ca962b11 None admin] RBAC: Authorizing `identity:get_user(user_id=d420d3d5da0449a4a922830b04be1420)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:11.215899 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a99505-19c2-499d-9423-f4e6ca962b11 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:11.217568 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 167/315] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 25 11:52:11 2022] GET /identity/v3/users/d420d3d5da0449a4a922830b04be1420 => generated 297 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:11.223039 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc77316-e731-4ef4-831e-77049a237589 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:11.225920 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:11.325508 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc77316-e731-4ef4-831e-77049a237589 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:11.359921 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb968d-88dc-45b4-92d3-da826e9d70a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:11.360573 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb968d-88dc-45b4-92d3-da826e9d70a7 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:11.360854 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb968d-88dc-45b4-92d3-da826e9d70a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:11.361128 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb968d-88dc-45b4-92d3-da826e9d70a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:11.428421 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffb968d-88dc-45b4-92d3-da826e9d70a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:11.429897 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffb968d-88dc-45b4-92d3-da826e9d70a7 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:11.433231 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:11.534691 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 149/316] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 25 11:52:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 11:52:11.540090 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a99505-19c2-499d-9423-f4e6ca962b11 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:11.559619 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:11.645017 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a99505-19c2-499d-9423-f4e6ca962b11 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:11.678423 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11ae084-7ed3-427e-9c06-ab412bce5bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:11.679282 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ae084-7ed3-427e-9c06-ab412bce5bcb None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:11.679560 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ae084-7ed3-427e-9c06-ab412bce5bcb None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:11.679916 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ae084-7ed3-427e-9c06-ab412bce5bcb None admin] PATH_INFO: `/v3/projects/fbdd1a23ea8a4df7ad5aa9fb346fe0da` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:11.681093 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11ae084-7ed3-427e-9c06-ab412bce5bcb None admin] RBAC: Authorizing `identity:get_project(project_id=fbdd1a23ea8a4df7ad5aa9fb346fe0da)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:11.682532 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11ae084-7ed3-427e-9c06-ab412bce5bcb None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:11.684562 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 168/317] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 25 11:52:11 2022] GET /identity/v3/projects/fbdd1a23ea8a4df7ad5aa9fb346fe0da => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:11.690394 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb968d-88dc-45b4-92d3-da826e9d70a7 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:11.796601 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb968d-88dc-45b4-92d3-da826e9d70a7 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:11.798471 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:11.833475 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366fc7b6-b100-4a9f-b095-a391876b6402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:11.834483 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366fc7b6-b100-4a9f-b095-a391876b6402 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:11.834971 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366fc7b6-b100-4a9f-b095-a391876b6402 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:11.835473 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366fc7b6-b100-4a9f-b095-a391876b6402 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:11.836563 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366fc7b6-b100-4a9f-b095-a391876b6402 None admin] RBAC: Adding query filter params (role.id=038496e26bf34707a6fa4de9bc368de5, scope.project.id=fbdd1a23ea8a4df7ad5aa9fb346fe0da, user.id=d420d3d5da0449a4a922830b04be1420) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:11.837086 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366fc7b6-b100-4a9f-b095-a391876b6402 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:11.838541 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366fc7b6-b100-4a9f-b095-a391876b6402 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:11.845657 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 150/318] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 25 11:52:11 2022] GET /identity/v3/role_assignments?user.id=d420d3d5da0449a4a922830b04be1420&scope.project.id=fbdd1a23ea8a4df7ad5aa9fb346fe0da&role.id=038496e26bf34707a6fa4de9bc368de5 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:12.777495 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8630a22f-a540-4991-bb4d-70a1e3dcf272 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:12.778063 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8630a22f-a540-4991-bb4d-70a1e3dcf272 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:12.778063 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8630a22f-a540-4991-bb4d-70a1e3dcf272 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:12.779642 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 169/319] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:52:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:52:12.785235 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d9dba-c249-4c2e-842d-a9423fd7dca8 None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:12.785727 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d9dba-c249-4c2e-842d-a9423fd7dca8 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:12.785828 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d9dba-c249-4c2e-842d-a9423fd7dca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:12.804458 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-4b7d9dba-c249-4c2e-842d-a9423fd7dca8 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:52:12.806466 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-4b7d9dba-c249-4c2e-842d-a9423fd7dca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:52:12.884961 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 151/320] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:52:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 11:52:12.908731 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8630a22f-a540-4991-bb4d-70a1e3dcf272 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:12.966128 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e43e829-1c93-4dea-b1d9-d4b12c8ef4e6 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:12.966432 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e43e829-1c93-4dea-b1d9-d4b12c8ef4e6 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:12.966700 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e43e829-1c93-4dea-b1d9-d4b12c8ef4e6 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:12.968098 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 152/321] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:52:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:52:12.973021 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f7a50-b985-43fb-9c12-b38ad5622be1 None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:12.973312 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f7a50-b985-43fb-9c12-b38ad5622be1 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:12.973591 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f7a50-b985-43fb-9c12-b38ad5622be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:12.990522 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-f17f7a50-b985-43fb-9c12-b38ad5622be1 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:52:12.991716 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-f17f7a50-b985-43fb-9c12-b38ad5622be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:52:12.999479 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:13.017940 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8630a22f-a540-4991-bb4d-70a1e3dcf272 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:13.053813 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c38b076-652d-4d06-9f23-55baa31b144b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:13.054533 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c38b076-652d-4d06-9f23-55baa31b144b None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:13.054819 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c38b076-652d-4d06-9f23-55baa31b144b None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:13.055103 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c38b076-652d-4d06-9f23-55baa31b144b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:13.065406 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c38b076-652d-4d06-9f23-55baa31b144b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:52:13.066802 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 153/322] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:52:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 11:52:13.069030 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3340defb-5be2-499f-97a3-6af9eb6db3e6 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:13.069325 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3340defb-5be2-499f-97a3-6af9eb6db3e6 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:13.069604 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3340defb-5be2-499f-97a3-6af9eb6db3e6 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:13.071060 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 154/323] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:52:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:52:13.073989 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-9c38b076-652d-4d06-9f23-55baa31b144b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 11:52:13.073989 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:13.073989 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:13.073989 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:13.073989 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:13.073989 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:13.073989 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:13.073989 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:13.073989 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:13.073989 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:13.073989 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:13.073989 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:13.073989 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:52:13.073989 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:52:13.073989 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:52:13.073989 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:52:13.074836 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:52:13.074836 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:52:13.074836 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:52:13.074836 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:52:13.074836 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:13.074836 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:13.074836 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:13.074836 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:13.074836 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:13.074836 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:13.074836 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:13.074836 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:52:13.074836 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:13.074836 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:13.074836 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:13.074836 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:13.075655 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:13.075655 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:13.075655 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:13.075655 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:13.075655 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:52:13.075655 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:52:13.075655 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:52:13.075655 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:52:13.075655 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:52:13.075655 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:52:13.075655 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 11:52:13.075655 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:52:13.075655 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 170/324] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 25 11:52:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:13.076885 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd224f5f-25b6-421a-91aa-0c82424bfd5a None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:13.077046 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd224f5f-25b6-421a-91aa-0c82424bfd5a None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:13.077288 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd224f5f-25b6-421a-91aa-0c82424bfd5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:13.080497 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c38b076-652d-4d06-9f23-55baa31b144b None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:13.095573 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-dd224f5f-25b6-421a-91aa-0c82424bfd5a None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:52:13.096808 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-dd224f5f-25b6-421a-91aa-0c82424bfd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:52:13.123030 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:13.169792 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 155/325] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:52:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 11:52:13.170637 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd224f5f-25b6-421a-91aa-0c82424bfd5a None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:13.190759 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c38b076-652d-4d06-9f23-55baa31b144b None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:13.225158 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e53de-6716-4fe4-90a6-cee00ad8170e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:13.225831 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e53de-6716-4fe4-90a6-cee00ad8170e None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:13.226117 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e53de-6716-4fe4-90a6-cee00ad8170e None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:13.226401 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e53de-6716-4fe4-90a6-cee00ad8170e None admin] PATH_INFO: `/v3/roles` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:13.227142 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e53de-6716-4fe4-90a6-cee00ad8170e None admin] RBAC: Adding query filter params (name=reader) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:13.227456 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e53de-6716-4fe4-90a6-cee00ad8170e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:13.228876 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e53de-6716-4fe4-90a6-cee00ad8170e None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:13.236978 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 171/326] 10.222.0.44 () {56 vars in 1101 bytes} [Wed May 25 11:52:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:52:13.243489 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e53de-6716-4fe4-90a6-cee00ad8170e None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:13.252084 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:13.270360 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd224f5f-25b6-421a-91aa-0c82424bfd5a None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:13.303949 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be10a27-83a5-4ce4-84ea-5377a83b530f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:13.304677 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be10a27-83a5-4ce4-84ea-5377a83b530f None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:13.304964 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be10a27-83a5-4ce4-84ea-5377a83b530f None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:13.305239 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be10a27-83a5-4ce4-84ea-5377a83b530f None admin] PATH_INFO: `/v3/domains/default` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:13.306405 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be10a27-83a5-4ce4-84ea-5377a83b530f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:13.307880 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be10a27-83a5-4ce4-84ea-5377a83b530f None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:13.309636 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 156/327] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:52:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:13.310234 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be10a27-83a5-4ce4-84ea-5377a83b530f None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:13.337631 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:13.343122 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e53de-6716-4fe4-90a6-cee00ad8170e None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:13.375004 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe69aa-7a02-4319-89a1-921b6b07f0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:13.375825 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe69aa-7a02-4319-89a1-921b6b07f0b9 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:13.376106 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe69aa-7a02-4319-89a1-921b6b07f0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:13.376383 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe69aa-7a02-4319-89a1-921b6b07f0b9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:13.388049 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fe69aa-7a02-4319-89a1-921b6b07f0b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:52:13.397881 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-00fe69aa-7a02-4319-89a1-921b6b07f0b9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 11:52:13.397881 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:13.397881 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:13.397881 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:13.397881 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:13.397881 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:13.397881 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:13.397881 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:13.397881 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:13.397881 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:13.397881 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:13.397881 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:13.397881 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:52:13.397881 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:52:13.397881 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:52:13.397881 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:52:13.398978 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:52:13.398978 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:52:13.398978 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:52:13.398978 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:52:13.398978 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:13.398978 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:13.398978 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:13.398978 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:13.398978 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:13.398978 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:13.398978 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:13.398978 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:52:13.398978 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:13.398978 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:13.398978 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:13.398978 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:13.399995 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:13.399995 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:13.399995 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:13.399995 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:13.399995 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:52:13.399995 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:52:13.399995 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:52:13.399995 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:52:13.399995 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:52:13.399995 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:52:13.399995 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 11:52:13.399995 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:52:13.399995 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 172/328] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 25 11:52:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:13.399995 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe69aa-7a02-4319-89a1-921b6b07f0b9 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:13.414871 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be10a27-83a5-4ce4-84ea-5377a83b530f None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:13.448016 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec1c55-0d82-4a65-9026-b4ed42a2baa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:13.449435 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec1c55-0d82-4a65-9026-b4ed42a2baa2 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:13.449722 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec1c55-0d82-4a65-9026-b4ed42a2baa2 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:13.449997 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec1c55-0d82-4a65-9026-b4ed42a2baa2 None admin] PATH_INFO: `/v3/users/9f01f513f8504c368c4e3ee1bd9567e2` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:13.451193 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bec1c55-0d82-4a65-9026-b4ed42a2baa2 None admin] RBAC: Authorizing `identity:get_user(user_id=9f01f513f8504c368c4e3ee1bd9567e2)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:13.452682 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bec1c55-0d82-4a65-9026-b4ed42a2baa2 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:13.454290 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 157/329] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 25 11:52:13 2022] GET /identity/v3/users/9f01f513f8504c368c4e3ee1bd9567e2 => generated 293 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:13.455045 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec1c55-0d82-4a65-9026-b4ed42a2baa2 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:13.464833 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:13.503747 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe69aa-7a02-4319-89a1-921b6b07f0b9 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:13.536839 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33f5e8d-8887-46a5-abfc-a46bb62736e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:13.537501 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f5e8d-8887-46a5-abfc-a46bb62736e5 None admin] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:13.537783 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f5e8d-8887-46a5-abfc-a46bb62736e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:13.538060 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f5e8d-8887-46a5-abfc-a46bb62736e5 None admin] PATH_INFO: `/v3/groups` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:13.538738 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33f5e8d-8887-46a5-abfc-a46bb62736e5 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:13.540208 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33f5e8d-8887-46a5-abfc-a46bb62736e5 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:13.544990 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:13.553199 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 173/330] 10.222.0.44 () {60 vars in 1134 bytes} [Wed May 25 11:52:13 2022] POST /identity/v3/groups => generated 226 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 11:52:13.554028 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33f5e8d-8887-46a5-abfc-a46bb62736e5 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:13.554298 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec1c55-0d82-4a65-9026-b4ed42a2baa2 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:13.593466 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed21f3e-a4a2-4a7e-9430-eabdcefd4c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:13.594163 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed21f3e-a4a2-4a7e-9430-eabdcefd4c65 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:13.594453 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed21f3e-a4a2-4a7e-9430-eabdcefd4c65 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:13.594732 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed21f3e-a4a2-4a7e-9430-eabdcefd4c65 None admin] PATH_INFO: `/v3/roles` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:13.595493 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed21f3e-a4a2-4a7e-9430-eabdcefd4c65 None admin] RBAC: Adding query filter params (name=member) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:13.595823 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed21f3e-a4a2-4a7e-9430-eabdcefd4c65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:13.597303 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed21f3e-a4a2-4a7e-9430-eabdcefd4c65 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:13.606909 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 158/331] 10.222.0.44 () {56 vars in 1101 bytes} [Wed May 25 11:52:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:13.612801 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed21f3e-a4a2-4a7e-9430-eabdcefd4c65 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:13.671264 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33f5e8d-8887-46a5-abfc-a46bb62736e5 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:13.701435 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:13.712615 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faecc41-deb2-4e61-bf04-7a57a127bf41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:13.713607 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faecc41-deb2-4e61-bf04-7a57a127bf41 None admin] REQUEST_METHOD: `PUT` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:13.713896 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faecc41-deb2-4e61-bf04-7a57a127bf41 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:13.714722 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faecc41-deb2-4e61-bf04-7a57a127bf41 None admin] PATH_INFO: `/v3/system/users/9f01f513f8504c368c4e3ee1bd9567e2/roles/038496e26bf34707a6fa4de9bc368de5` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:13.716321 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faecc41-deb2-4e61-bf04-7a57a127bf41 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9f01f513f8504c368c4e3ee1bd9567e2, role_id=038496e26bf34707a6fa4de9bc368de5)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:13.717723 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faecc41-deb2-4e61-bf04-7a57a127bf41 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:13.727654 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 174/332] 10.222.0.44 () {58 vars in 1334 bytes} [Wed May 25 11:52:13 2022] PUT /identity/v3/system/users/9f01f513f8504c368c4e3ee1bd9567e2/roles/038496e26bf34707a6fa4de9bc368de5 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 11:52:13.743849 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed21f3e-a4a2-4a7e-9430-eabdcefd4c65 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:13.784333 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7497bf-aebe-4740-a279-b54cc03c96b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:13.785243 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7497bf-aebe-4740-a279-b54cc03c96b0 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:13.785525 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7497bf-aebe-4740-a279-b54cc03c96b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:13.786087 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7497bf-aebe-4740-a279-b54cc03c96b0 None admin] PATH_INFO: `/v3/users/c86e0357726f490cb67fbbe326166392` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:13.787136 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7497bf-aebe-4740-a279-b54cc03c96b0 None admin] RBAC: Authorizing `identity:get_user(user_id=c86e0357726f490cb67fbbe326166392)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:13.788657 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7497bf-aebe-4740-a279-b54cc03c96b0 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:13.790600 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 159/333] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 25 11:52:13 2022] GET /identity/v3/users/c86e0357726f490cb67fbbe326166392 => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:52:13.797413 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faecc41-deb2-4e61-bf04-7a57a127bf41 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:13.929712 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faecc41-deb2-4e61-bf04-7a57a127bf41 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:13.966339 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb02111-8b49-45cb-bf95-dad5f69e62c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:13.966996 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb02111-8b49-45cb-bf95-dad5f69e62c7 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:13.967282 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb02111-8b49-45cb-bf95-dad5f69e62c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:13.967592 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb02111-8b49-45cb-bf95-dad5f69e62c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:13.968556 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb02111-8b49-45cb-bf95-dad5f69e62c7 None admin] RBAC: Adding query filter params (role.id=0bb7b8a3ae8f4d03a7f575ca8904963c, user.id=c86e0357726f490cb67fbbe326166392, scope.system=all) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:13.968923 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb02111-8b49-45cb-bf95-dad5f69e62c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:13.970378 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb02111-8b49-45cb-bf95-dad5f69e62c7 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:13.983051 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 175/334] 10.222.0.44 () {56 vars in 1308 bytes} [Wed May 25 11:52:13 2022] GET /identity/v3/role_assignments?user.id=c86e0357726f490cb67fbbe326166392&scope.system=all&role.id=0bb7b8a3ae8f4d03a7f575ca8904963c => generated 510 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:16.379305 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae8545-00d7-4e1d-a705-be0502334d01 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:16.380160 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae8545-00d7-4e1d-a705-be0502334d01 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:16.380160 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae8545-00d7-4e1d-a705-be0502334d01 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:16.381545 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 160/335] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:52:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:52:16.393350 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3f247-fdba-4ac9-943f-6ede47aa38cc None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:16.393849 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3f247-fdba-4ac9-943f-6ede47aa38cc None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:16.393930 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3f247-fdba-4ac9-943f-6ede47aa38cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:16.403189 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26041511-8650-4a65-9eb9-eeba45cc46e1 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:16.403486 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26041511-8650-4a65-9eb9-eeba45cc46e1 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:16.403754 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26041511-8650-4a65-9eb9-eeba45cc46e1 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:16.405470 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 161/336] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:52:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 11:52:16.411139 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed800c-ea1e-4491-ac6e-6264fec2b5f4 None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:16.411433 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed800c-ea1e-4491-ac6e-6264fec2b5f4 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:16.411716 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed800c-ea1e-4491-ac6e-6264fec2b5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:16.433892 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-5fa3f247-fdba-4ac9-943f-6ede47aa38cc None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:52:16.435017 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-5fa3f247-fdba-4ac9-943f-6ede47aa38cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:52:16.447603 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-16ed800c-ea1e-4491-ac6e-6264fec2b5f4 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:52:16.449417 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-16ed800c-ea1e-4491-ac6e-6264fec2b5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:52:16.490625 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:16.550149 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:16.620957 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 162/337] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:52:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 11:52:16.624710 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 176/338] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:52:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 11:52:16.652056 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed800c-ea1e-4491-ac6e-6264fec2b5f4 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:16.699654 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa3f247-fdba-4ac9-943f-6ede47aa38cc None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:16.843600 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed800c-ea1e-4491-ac6e-6264fec2b5f4 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:16.886899 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa3f247-fdba-4ac9-943f-6ede47aa38cc None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:16.913857 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c58f73e-d1c7-41f3-99d5-bd86369a73a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:16.914747 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58f73e-d1c7-41f3-99d5-bd86369a73a6 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:16.915035 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58f73e-d1c7-41f3-99d5-bd86369a73a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:16.915313 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58f73e-d1c7-41f3-99d5-bd86369a73a6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:16.927387 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c58f73e-d1c7-41f3-99d5-bd86369a73a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:52:16.940415 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-6c58f73e-d1c7-41f3-99d5-bd86369a73a6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 11:52:16.940415 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:16.940415 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:16.940415 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:16.940415 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:16.940415 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:16.940415 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:16.940415 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:16.940415 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:16.940415 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:16.940415 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:16.940415 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:16.940415 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:52:16.940415 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:52:16.940415 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:52:16.940415 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:52:16.941373 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:52:16.941373 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:52:16.941373 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:52:16.941373 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:52:16.941373 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:16.941373 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:16.941373 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:16.941373 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:16.941373 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:16.941373 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:16.941373 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:16.941373 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:52:16.941373 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:16.941373 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:16.941373 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:16.941373 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:16.942196 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:16.942196 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:16.942196 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:16.942196 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:16.942196 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:52:16.942196 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:52:16.942196 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:52:16.942196 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:52:16.942196 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:52:16.942196 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:52:16.942196 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 11:52:16.942196 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:52:16.942820 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 163/339] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 25 11:52:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:16.949887 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c58f73e-d1c7-41f3-99d5-bd86369a73a6 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:16.968301 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:16.985395 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5b41e-dd01-4f68-bbd2-a8fa593bfe35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:16.986298 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5b41e-dd01-4f68-bbd2-a8fa593bfe35 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:16.986588 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5b41e-dd01-4f68-bbd2-a8fa593bfe35 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:16.986866 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5b41e-dd01-4f68-bbd2-a8fa593bfe35 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:17.014719 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc5b41e-dd01-4f68-bbd2-a8fa593bfe35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:52:17.024127 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-0cc5b41e-dd01-4f68-bbd2-a8fa593bfe35 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 11:52:17.024127 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:17.024127 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:17.024127 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:17.024127 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:17.024127 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:17.024127 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:17.024127 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:17.024127 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:17.024127 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:17.024127 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:17.024127 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:17.024127 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:52:17.024127 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:52:17.024127 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:52:17.024127 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:52:17.026236 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:52:17.026236 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:52:17.026236 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:52:17.026236 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:52:17.026236 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:17.026236 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:17.026236 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:17.026236 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:17.026236 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:17.026236 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:17.026236 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:17.026236 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:52:17.026236 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:17.026236 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:17.026236 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:17.026236 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:17.028894 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:17.028894 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:17.028894 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:17.028894 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:17.028894 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:52:17.028894 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:52:17.028894 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:52:17.028894 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:52:17.028894 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:52:17.028894 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:52:17.028894 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 11:52:17.028894 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:52:17.028894 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 177/340] 10.222.0.44 () {56 vars in 1114 bytes} [Wed May 25 11:52:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:17.036242 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5b41e-dd01-4f68-bbd2-a8fa593bfe35 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:17.079106 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c58f73e-d1c7-41f3-99d5-bd86369a73a6 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:17.121054 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:17.131181 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fac91c-a2ad-4dba-81f5-fed674287ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:17.132030 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fac91c-a2ad-4dba-81f5-fed674287ca2 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:17.132798 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fac91c-a2ad-4dba-81f5-fed674287ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:17.132798 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fac91c-a2ad-4dba-81f5-fed674287ca2 None admin] PATH_INFO: `/v3/roles` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:17.133316 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fac91c-a2ad-4dba-81f5-fed674287ca2 None admin] RBAC: Adding query filter params (name=member) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:17.133629 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fac91c-a2ad-4dba-81f5-fed674287ca2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:17.139823 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fac91c-a2ad-4dba-81f5-fed674287ca2 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:17.145074 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 164/341] 10.222.0.44 () {56 vars in 1101 bytes} [Wed May 25 11:52:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:17.146650 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9cbe8-7bcb-4d9c-beff-5a1b5977d606 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:17.146940 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9cbe8-7bcb-4d9c-beff-5a1b5977d606 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:17.147477 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9cbe8-7bcb-4d9c-beff-5a1b5977d606 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:17.152351 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 165/342] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:52:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:52:17.154800 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9cbe8-7bcb-4d9c-beff-5a1b5977d606 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:17.265277 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5b41e-dd01-4f68-bbd2-a8fa593bfe35 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:17.324958 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:17.336669 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ee178b-0f0d-4650-a662-d1d7f4178eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:17.337349 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee178b-0f0d-4650-a662-d1d7f4178eb3 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:17.337637 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee178b-0f0d-4650-a662-d1d7f4178eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:17.337918 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee178b-0f0d-4650-a662-d1d7f4178eb3 None admin] PATH_INFO: `/v3/roles` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:17.338684 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ee178b-0f0d-4650-a662-d1d7f4178eb3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:17.339542 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ee178b-0f0d-4650-a662-d1d7f4178eb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:17.340955 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ee178b-0f0d-4650-a662-d1d7f4178eb3 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:17.355175 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 178/343] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 25 11:52:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:17.356515 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36f62e-d146-41f3-8bce-1b15f10321b4 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:17.356806 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36f62e-d146-41f3-8bce-1b15f10321b4 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:17.357082 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36f62e-d146-41f3-8bce-1b15f10321b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:17.367025 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9cbe8-7bcb-4d9c-beff-5a1b5977d606 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:17.385175 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-ac36f62e-d146-41f3-8bce-1b15f10321b4 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:52:17.386410 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-ac36f62e-d146-41f3-8bce-1b15f10321b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:52:17.423733 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13779479-1e01-481c-bdb7-dc33d4d580b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:17.424415 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13779479-1e01-481c-bdb7-dc33d4d580b2 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:17.424698 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13779479-1e01-481c-bdb7-dc33d4d580b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:17.425861 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13779479-1e01-481c-bdb7-dc33d4d580b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:17.497413 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 179/344] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:52:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 11:52:17.500280 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30daeb5-d026-48a6-a626-87965caf5c76 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:17.501717 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30daeb5-d026-48a6-a626-87965caf5c76 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:17.502224 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30daeb5-d026-48a6-a626-87965caf5c76 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:17.504990 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 180/345] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:52:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:52:17.506580 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30daeb5-d026-48a6-a626-87965caf5c76 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:17.533950 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13779479-1e01-481c-bdb7-dc33d4d580b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:17.536190 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13779479-1e01-481c-bdb7-dc33d4d580b2 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:17.549164 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:17.624712 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:17.633606 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30daeb5-d026-48a6-a626-87965caf5c76 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:17.654981 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 166/346] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 25 11:52:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 11:52:17.656703 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd80417-a7d2-431d-a74d-6088bcfaa210 None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:17.657136 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd80417-a7d2-431d-a74d-6088bcfaa210 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:17.657605 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd80417-a7d2-431d-a74d-6088bcfaa210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:17.670043 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca7a130-4ad8-4a13-84c2-68ce3052ad97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:17.671114 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca7a130-4ad8-4a13-84c2-68ce3052ad97 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:17.671654 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca7a130-4ad8-4a13-84c2-68ce3052ad97 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:17.672182 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca7a130-4ad8-4a13-84c2-68ce3052ad97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:17.676706 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-ffd80417-a7d2-431d-a74d-6088bcfaa210 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:52:17.677527 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-ffd80417-a7d2-431d-a74d-6088bcfaa210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:52:17.746357 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca7a130-4ad8-4a13-84c2-68ce3052ad97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:17.748237 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca7a130-4ad8-4a13-84c2-68ce3052ad97 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:17.756486 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 167/347] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:52:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 11:52:17.757331 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd80417-a7d2-431d-a74d-6088bcfaa210 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:17.781521 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:17.859056 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 181/348] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 25 11:52:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 11:52:17.860289 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca7a130-4ad8-4a13-84c2-68ce3052ad97 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:17.882659 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd80417-a7d2-431d-a74d-6088bcfaa210 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:17.885346 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:17.921145 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a9bda9-74be-4d60-bdd6-c8cc18a0716d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:17.922090 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9bda9-74be-4d60-bdd6-c8cc18a0716d None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:17.922380 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9bda9-74be-4d60-bdd6-c8cc18a0716d None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:17.922679 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9bda9-74be-4d60-bdd6-c8cc18a0716d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:17.935584 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a9bda9-74be-4d60-bdd6-c8cc18a0716d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:52:17.943661 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-f7a9bda9-74be-4d60-bdd6-c8cc18a0716d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 11:52:17.943661 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:17.943661 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:17.943661 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:17.943661 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:17.943661 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:17.943661 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:17.943661 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:17.943661 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:17.943661 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:17.943661 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:17.943661 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:17.943661 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:52:17.943661 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:52:17.943661 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:52:17.943661 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:52:17.944619 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:52:17.944619 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:52:17.944619 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:52:17.944619 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:52:17.944619 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:17.944619 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:17.944619 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:17.944619 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:17.944619 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:17.944619 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:17.944619 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:17.944619 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:52:17.944619 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:17.944619 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:17.944619 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:17.944619 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:17.945524 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:17.945524 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:17.945524 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:17.945524 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:17.945524 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:52:17.945524 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:52:17.945524 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:52:17.945524 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:52:17.945524 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:52:17.945524 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:52:17.945524 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 11:52:17.945524 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:52:17.945524 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 168/349] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 25 11:52:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:17.946200 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a9bda9-74be-4d60-bdd6-c8cc18a0716d None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:17.973096 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca7a130-4ad8-4a13-84c2-68ce3052ad97 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:18.005734 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:18.014697 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70958e5a-e975-4a4c-8e10-a1a3b956456e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:18.016013 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70958e5a-e975-4a4c-8e10-a1a3b956456e None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:18.016514 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70958e5a-e975-4a4c-8e10-a1a3b956456e None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:18.017028 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70958e5a-e975-4a4c-8e10-a1a3b956456e None admin] PATH_INFO: `/v3/projects/0499f6b6a46a4da2bb2ceedf8b6843b6` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:18.018483 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70958e5a-e975-4a4c-8e10-a1a3b956456e None admin] RBAC: Authorizing `identity:get_project(project_id=0499f6b6a46a4da2bb2ceedf8b6843b6)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:18.020230 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70958e5a-e975-4a4c-8e10-a1a3b956456e None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:18.022441 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 182/350] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 25 11:52:17 2022] GET /identity/v3/projects/0499f6b6a46a4da2bb2ceedf8b6843b6 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:18.023436 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70958e5a-e975-4a4c-8e10-a1a3b956456e None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:18.063873 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a9bda9-74be-4d60-bdd6-c8cc18a0716d None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:18.102759 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e692ec07-9d7d-4f54-826f-449da14442f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:18.102759 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692ec07-9d7d-4f54-826f-449da14442f7 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:18.102759 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692ec07-9d7d-4f54-826f-449da14442f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:18.103205 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692ec07-9d7d-4f54-826f-449da14442f7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:18.117528 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e692ec07-9d7d-4f54-826f-449da14442f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:52:18.129055 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-e692ec07-9d7d-4f54-826f-449da14442f7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 11:52:18.129055 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:18.129055 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:18.129055 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:18.129055 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:18.129055 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:18.129055 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:18.129055 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:18.129055 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:18.129055 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:18.129055 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:18.129055 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:18.129055 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:52:18.129055 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:52:18.129055 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:52:18.129055 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:52:18.130008 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:52:18.130008 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:52:18.130008 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:52:18.130008 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:52:18.130008 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:18.130008 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:18.130008 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:18.130008 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:18.130008 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:18.130008 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:18.130008 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:18.130008 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:52:18.130008 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:18.130008 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:18.130008 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:18.130008 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:18.130824 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:18.130824 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:18.130824 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:18.130824 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:18.130824 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:52:18.130824 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:52:18.130824 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:52:18.130824 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:52:18.130824 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:52:18.130824 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:52:18.130824 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 11:52:18.130824 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:52:18.130824 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 169/351] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 25 11:52:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:18.131474 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e692ec07-9d7d-4f54-826f-449da14442f7 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:18.141956 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70958e5a-e975-4a4c-8e10-a1a3b956456e None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:18.162141 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:18.195109 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88568630-f0b2-4e7c-acee-bfea55ea8e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:18.197129 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88568630-f0b2-4e7c-acee-bfea55ea8e29 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:18.197129 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88568630-f0b2-4e7c-acee-bfea55ea8e29 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:18.197129 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88568630-f0b2-4e7c-acee-bfea55ea8e29 None admin] PATH_INFO: `/v3/projects/0499f6b6a46a4da2bb2ceedf8b6843b6` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:18.200090 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88568630-f0b2-4e7c-acee-bfea55ea8e29 None admin] RBAC: Authorizing `identity:get_project(project_id=0499f6b6a46a4da2bb2ceedf8b6843b6)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:18.202165 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88568630-f0b2-4e7c-acee-bfea55ea8e29 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:18.204545 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 183/352] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 25 11:52:18 2022] GET /identity/v3/projects/0499f6b6a46a4da2bb2ceedf8b6843b6 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:18.204826 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88568630-f0b2-4e7c-acee-bfea55ea8e29 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:18.264869 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e692ec07-9d7d-4f54-826f-449da14442f7 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:18.295183 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:18.314064 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6014fb-6d50-4753-8e97-f94341628d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:18.314749 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6014fb-6d50-4753-8e97-f94341628d10 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:18.315144 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6014fb-6d50-4753-8e97-f94341628d10 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:18.315428 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6014fb-6d50-4753-8e97-f94341628d10 None admin] PATH_INFO: `/v3/roles` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:18.317223 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6014fb-6d50-4753-8e97-f94341628d10 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:18.317540 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6014fb-6d50-4753-8e97-f94341628d10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:18.319032 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6014fb-6d50-4753-8e97-f94341628d10 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:18.331578 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 170/353] 10.222.0.44 () {56 vars in 1101 bytes} [Wed May 25 11:52:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:18.331578 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be584bfb-fefa-4f2a-b816-d171177d8bf6 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:18.331578 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be584bfb-fefa-4f2a-b816-d171177d8bf6 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:18.331578 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be584bfb-fefa-4f2a-b816-d171177d8bf6 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:18.331578 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 171/354] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:52:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:52:18.332161 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be584bfb-fefa-4f2a-b816-d171177d8bf6 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:18.347990 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88568630-f0b2-4e7c-acee-bfea55ea8e29 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:18.386223 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec62fd91-5d4c-4126-9c5c-ebf3de0c1f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:18.387524 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62fd91-5d4c-4126-9c5c-ebf3de0c1f28 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:18.388038 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62fd91-5d4c-4126-9c5c-ebf3de0c1f28 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:18.388523 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62fd91-5d4c-4126-9c5c-ebf3de0c1f28 None admin] PATH_INFO: `/v3/groups/1d3c5d1322fb40a68ec8f5172066c731` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:18.395674 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec62fd91-5d4c-4126-9c5c-ebf3de0c1f28 None admin] RBAC: Authorizing `identity:get_group(group_id=1d3c5d1322fb40a68ec8f5172066c731)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:18.396972 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec62fd91-5d4c-4126-9c5c-ebf3de0c1f28 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:18.399208 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 184/355] 10.222.0.44 () {56 vars in 1180 bytes} [Wed May 25 11:52:18 2022] GET /identity/v3/groups/1d3c5d1322fb40a68ec8f5172066c731 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:18.400643 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec62fd91-5d4c-4126-9c5c-ebf3de0c1f28 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:18.447528 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:18.471137 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be584bfb-fefa-4f2a-b816-d171177d8bf6 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:18.521916 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3bb344-d3f4-4c8b-9fdf-37047a5ca962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:18.523132 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3bb344-d3f4-4c8b-9fdf-37047a5ca962 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:18.523456 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3bb344-d3f4-4c8b-9fdf-37047a5ca962 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:18.523779 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3bb344-d3f4-4c8b-9fdf-37047a5ca962 None admin] PATH_INFO: `/v3/roles` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:18.524703 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3bb344-d3f4-4c8b-9fdf-37047a5ca962 None admin] RBAC: Adding query filter params (name=member) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:18.524896 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3bb344-d3f4-4c8b-9fdf-37047a5ca962 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:18.526290 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3bb344-d3f4-4c8b-9fdf-37047a5ca962 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:18.535143 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec62fd91-5d4c-4126-9c5c-ebf3de0c1f28 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:18.537666 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 172/356] 10.222.0.44 () {56 vars in 1101 bytes} [Wed May 25 11:52:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:18.537666 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3bb344-d3f4-4c8b-9fdf-37047a5ca962 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:18.577351 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:18.587718 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64188c-121e-41e4-aa2a-0b2528b3338d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:18.588649 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64188c-121e-41e4-aa2a-0b2528b3338d None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:18.588967 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64188c-121e-41e4-aa2a-0b2528b3338d None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:18.589248 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64188c-121e-41e4-aa2a-0b2528b3338d None admin] PATH_INFO: `/v3/groups/1d3c5d1322fb40a68ec8f5172066c731` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:18.590895 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d64188c-121e-41e4-aa2a-0b2528b3338d None admin] RBAC: Authorizing `identity:get_group(group_id=1d3c5d1322fb40a68ec8f5172066c731)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:18.592811 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d64188c-121e-41e4-aa2a-0b2528b3338d None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:18.595235 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 185/357] 10.222.0.44 () {56 vars in 1180 bytes} [Wed May 25 11:52:18 2022] GET /identity/v3/groups/1d3c5d1322fb40a68ec8f5172066c731 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:18.596995 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75600650-f1b6-484f-b48e-9d4c5833dac9 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:18.597688 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75600650-f1b6-484f-b48e-9d4c5833dac9 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:18.597977 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75600650-f1b6-484f-b48e-9d4c5833dac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:18.617197 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-75600650-f1b6-484f-b48e-9d4c5833dac9 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:52:18.618398 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-75600650-f1b6-484f-b48e-9d4c5833dac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:52:18.655552 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3bb344-d3f4-4c8b-9fdf-37047a5ca962 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:18.698130 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac40f36-a359-4c5d-9395-293da8b1436b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:18.699050 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac40f36-a359-4c5d-9395-293da8b1436b None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:18.699336 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac40f36-a359-4c5d-9395-293da8b1436b None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:18.699618 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac40f36-a359-4c5d-9395-293da8b1436b None admin] PATH_INFO: `/v3/users/9f01f513f8504c368c4e3ee1bd9567e2` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:18.700075 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 186/358] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:52:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 11:52:18.700879 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac40f36-a359-4c5d-9395-293da8b1436b None admin] RBAC: Authorizing `identity:get_user(user_id=9f01f513f8504c368c4e3ee1bd9567e2)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:18.700978 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75600650-f1b6-484f-b48e-9d4c5833dac9 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:18.702328 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac40f36-a359-4c5d-9395-293da8b1436b None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:18.704753 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 173/359] 10.222.0.44 () {56 vars in 1177 bytes} [Wed May 25 11:52:18 2022] GET /identity/v3/users/9f01f513f8504c368c4e3ee1bd9567e2 => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:18.705056 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac40f36-a359-4c5d-9395-293da8b1436b None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:18.724787 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:18.825444 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac40f36-a359-4c5d-9395-293da8b1436b None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:18.839654 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75600650-f1b6-484f-b48e-9d4c5833dac9 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:18.871014 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:18.871987 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b621eabe-cdae-49d5-8163-d1c114617c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:18.873274 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b621eabe-cdae-49d5-8163-d1c114617c14 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:18.873559 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b621eabe-cdae-49d5-8163-d1c114617c14 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:18.873835 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b621eabe-cdae-49d5-8163-d1c114617c14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:18.883584 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97559fa-913f-4342-91af-5fa1e9e6ab08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:18.884288 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97559fa-913f-4342-91af-5fa1e9e6ab08 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:18.884560 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97559fa-913f-4342-91af-5fa1e9e6ab08 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:18.884838 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97559fa-913f-4342-91af-5fa1e9e6ab08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:18.885703 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97559fa-913f-4342-91af-5fa1e9e6ab08 None admin] RBAC: Adding query filter params (group.id=1d3c5d1322fb40a68ec8f5172066c731, role.id=0bb7b8a3ae8f4d03a7f575ca8904963c, scope.project.id=0499f6b6a46a4da2bb2ceedf8b6843b6) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:18.886575 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97559fa-913f-4342-91af-5fa1e9e6ab08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:18.888094 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97559fa-913f-4342-91af-5fa1e9e6ab08 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:18.894735 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 187/360] 10.222.0.44 () {56 vars in 1376 bytes} [Wed May 25 11:52:18 2022] GET /identity/v3/role_assignments?group.id=1d3c5d1322fb40a68ec8f5172066c731&scope.project.id=0499f6b6a46a4da2bb2ceedf8b6843b6&role.id=0bb7b8a3ae8f4d03a7f575ca8904963c => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:18.895978 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60402e87-2355-4f9f-bec9-6be8ef2b0405 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:18.896275 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60402e87-2355-4f9f-bec9-6be8ef2b0405 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:18.896556 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60402e87-2355-4f9f-bec9-6be8ef2b0405 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:18.898398 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 188/361] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:52:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:52:18.899132 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60402e87-2355-4f9f-bec9-6be8ef2b0405 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:18.973155 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b621eabe-cdae-49d5-8163-d1c114617c14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:18.974592 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b621eabe-cdae-49d5-8163-d1c114617c14 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:18.994491 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:19.049360 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60402e87-2355-4f9f-bec9-6be8ef2b0405 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:19.091991 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba9912-c938-437c-b0f4-e69061572872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:19.092767 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba9912-c938-437c-b0f4-e69061572872 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:19.093123 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba9912-c938-437c-b0f4-e69061572872 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:19.093406 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba9912-c938-437c-b0f4-e69061572872 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:19.094244 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aba9912-c938-437c-b0f4-e69061572872 None admin] RBAC: Adding query filter params (group.id=1d3c5d1322fb40a68ec8f5172066c731, role.id=1d75537a128747f180972029d0241cb4, scope.project.id=0499f6b6a46a4da2bb2ceedf8b6843b6) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:19.094564 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aba9912-c938-437c-b0f4-e69061572872 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:19.096053 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aba9912-c938-437c-b0f4-e69061572872 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:19.097425 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 174/362] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 25 11:52:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 11:52:19.100831 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b621eabe-cdae-49d5-8163-d1c114617c14 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:19.105091 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 189/363] 10.222.0.44 () {56 vars in 1376 bytes} [Wed May 25 11:52:18 2022] GET /identity/v3/role_assignments?group.id=1d3c5d1322fb40a68ec8f5172066c731&scope.project.id=0499f6b6a46a4da2bb2ceedf8b6843b6&role.id=1d75537a128747f180972029d0241cb4 => generated 260 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:19.105815 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba9912-c938-437c-b0f4-e69061572872 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:19.208349 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:19.249588 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b621eabe-cdae-49d5-8163-d1c114617c14 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:19.269371 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:19.272306 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba9912-c938-437c-b0f4-e69061572872 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:19.294109 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af512c29-1e9c-4767-9a97-ee28386b6c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:19.294798 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af512c29-1e9c-4767-9a97-ee28386b6c92 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:19.295085 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af512c29-1e9c-4767-9a97-ee28386b6c92 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:19.295367 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af512c29-1e9c-4767-9a97-ee28386b6c92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:19.296340 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af512c29-1e9c-4767-9a97-ee28386b6c92 None admin] RBAC: Adding query filter params (role.id=038496e26bf34707a6fa4de9bc368de5, user.id=9f01f513f8504c368c4e3ee1bd9567e2, scope.system=all) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:19.296658 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af512c29-1e9c-4767-9a97-ee28386b6c92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:19.298274 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af512c29-1e9c-4767-9a97-ee28386b6c92 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:19.313298 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 175/364] 10.222.0.44 () {56 vars in 1308 bytes} [Wed May 25 11:52:19 2022] GET /identity/v3/role_assignments?user.id=9f01f513f8504c368c4e3ee1bd9567e2&scope.system=all&role.id=038496e26bf34707a6fa4de9bc368de5 => generated 510 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:19.314624 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a404f29-8edb-4c42-be1b-0272d27a6d3d None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:19.315021 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a404f29-8edb-4c42-be1b-0272d27a6d3d None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:19.315312 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a404f29-8edb-4c42-be1b-0272d27a6d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:19.322235 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483fdb97-05c2-44fd-8b07-3d9d69a9c4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:19.324370 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483fdb97-05c2-44fd-8b07-3d9d69a9c4e0 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:19.324672 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483fdb97-05c2-44fd-8b07-3d9d69a9c4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:19.324889 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483fdb97-05c2-44fd-8b07-3d9d69a9c4e0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:19.340143 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-0a404f29-8edb-4c42-be1b-0272d27a6d3d None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:52:19.341375 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-0a404f29-8edb-4c42-be1b-0272d27a6d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:52:19.341668 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483fdb97-05c2-44fd-8b07-3d9d69a9c4e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:52:19.352692 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-483fdb97-05c2-44fd-8b07-3d9d69a9c4e0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 11:52:19.352692 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:19.352692 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:19.352692 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:19.352692 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:19.352692 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:19.352692 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:19.352692 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:19.352692 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:19.352692 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:19.352692 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:19.352692 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:19.352692 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:52:19.352692 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:52:19.352692 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:52:19.352692 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:52:19.353661 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:52:19.353661 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:52:19.353661 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:52:19.353661 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:52:19.353661 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:19.353661 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:19.353661 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:19.353661 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:19.353661 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:19.353661 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:19.353661 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:19.353661 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:52:19.353661 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:19.353661 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:19.353661 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:19.353661 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:19.355028 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:19.355028 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:19.355028 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:19.355028 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:19.355028 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:52:19.355028 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:52:19.355028 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:52:19.355028 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:52:19.355028 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:52:19.355028 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:52:19.355028 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 11:52:19.355028 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:52:19.357751 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 190/365] 10.222.0.44 () {56 vars in 1114 bytes} [Wed May 25 11:52:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:19.358803 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483fdb97-05c2-44fd-8b07-3d9d69a9c4e0 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:19.461036 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 176/366] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:52:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 11:52:19.464734 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a404f29-8edb-4c42-be1b-0272d27a6d3d None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:19.543301 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483fdb97-05c2-44fd-8b07-3d9d69a9c4e0 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:19.581645 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:19.607688 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f46cd-f2ca-4703-85e3-be493ffc3a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:19.608705 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f46cd-f2ca-4703-85e3-be493ffc3a5f None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:19.609060 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f46cd-f2ca-4703-85e3-be493ffc3a5f None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:19.609410 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f46cd-f2ca-4703-85e3-be493ffc3a5f None admin] PATH_INFO: `/v3/projects/fbdd1a23ea8a4df7ad5aa9fb346fe0da` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:19.610693 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f46cd-f2ca-4703-85e3-be493ffc3a5f None admin] RBAC: Authorizing `identity:get_project(project_id=fbdd1a23ea8a4df7ad5aa9fb346fe0da)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:19.612311 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f46cd-f2ca-4703-85e3-be493ffc3a5f None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:19.618705 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 191/367] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 25 11:52:19 2022] GET /identity/v3/projects/fbdd1a23ea8a4df7ad5aa9fb346fe0da => generated 302 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:19.619681 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f46cd-f2ca-4703-85e3-be493ffc3a5f None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:19.629092 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a404f29-8edb-4c42-be1b-0272d27a6d3d None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:19.632152 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:19.669865 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110d3806-adb3-45c9-8efb-7c5c2f2785e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:19.670560 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d3806-adb3-45c9-8efb-7c5c2f2785e1 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:19.670849 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d3806-adb3-45c9-8efb-7c5c2f2785e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:19.671241 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d3806-adb3-45c9-8efb-7c5c2f2785e1 None admin] PATH_INFO: `/v3/roles` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:19.672047 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110d3806-adb3-45c9-8efb-7c5c2f2785e1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:19.672429 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110d3806-adb3-45c9-8efb-7c5c2f2785e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:19.674338 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110d3806-adb3-45c9-8efb-7c5c2f2785e1 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:19.685433 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 177/368] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 25 11:52:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:19.686260 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110d3806-adb3-45c9-8efb-7c5c2f2785e1 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:19.734670 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f46cd-f2ca-4703-85e3-be493ffc3a5f None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:19.773388 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa659fcd-51b2-45bd-bb37-7799c9ed31f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:19.774195 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa659fcd-51b2-45bd-bb37-7799c9ed31f7 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:19.774479 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa659fcd-51b2-45bd-bb37-7799c9ed31f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:19.774755 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa659fcd-51b2-45bd-bb37-7799c9ed31f7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:19.786431 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa659fcd-51b2-45bd-bb37-7799c9ed31f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:52:19.796142 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-fa659fcd-51b2-45bd-bb37-7799c9ed31f7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 11:52:19.796142 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:19.796142 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:19.796142 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:19.796142 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:19.796142 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:19.796142 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:19.796142 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:19.796142 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:19.796142 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:19.796142 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:19.796142 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:19.796142 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:52:19.796142 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:52:19.796142 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:52:19.796142 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:52:19.797067 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:52:19.797067 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:52:19.797067 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:52:19.797067 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:52:19.797067 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:19.797067 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:19.797067 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:19.797067 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:19.797067 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:19.797067 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:19.797067 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:19.797067 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:52:19.797067 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:19.797067 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:19.797067 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:19.797067 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:19.797866 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:19.797866 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:19.797866 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:19.797866 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:19.797866 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:52:19.797866 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:52:19.797866 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:52:19.797866 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:52:19.797866 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:52:19.797866 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:52:19.797866 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 11:52:19.797866 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:52:19.797866 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 192/369] 10.222.0.44 () {56 vars in 1096 bytes} [Wed May 25 11:52:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:19.798537 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa659fcd-51b2-45bd-bb37-7799c9ed31f7 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:19.808231 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110d3806-adb3-45c9-8efb-7c5c2f2785e1 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:19.856171 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:19.860054 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38627e3a-b469-4d88-a3ab-6b55de1576b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:19.860952 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38627e3a-b469-4d88-a3ab-6b55de1576b9 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:19.861232 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38627e3a-b469-4d88-a3ab-6b55de1576b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:19.861509 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38627e3a-b469-4d88-a3ab-6b55de1576b9 None admin] PATH_INFO: `/v3/groups/1d3c5d1322fb40a68ec8f5172066c731` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:19.864673 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38627e3a-b469-4d88-a3ab-6b55de1576b9 None admin] RBAC: Authorizing `identity:get_group(group_id=1d3c5d1322fb40a68ec8f5172066c731)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:19.866385 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38627e3a-b469-4d88-a3ab-6b55de1576b9 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:19.869475 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 178/370] 10.222.0.44 () {56 vars in 1180 bytes} [Wed May 25 11:52:19 2022] GET /identity/v3/groups/1d3c5d1322fb40a68ec8f5172066c731 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:19.869864 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38627e3a-b469-4d88-a3ab-6b55de1576b9 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:19.916232 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:19.938858 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa659fcd-51b2-45bd-bb37-7799c9ed31f7 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:19.981761 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f023565-45a6-4388-b633-3a34c00c00fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:19.982423 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f023565-45a6-4388-b633-3a34c00c00fe None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:19.982709 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f023565-45a6-4388-b633-3a34c00c00fe None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:19.982996 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f023565-45a6-4388-b633-3a34c00c00fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:20.004649 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38627e3a-b469-4d88-a3ab-6b55de1576b9 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:20.047301 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c01ea8-57c2-49fa-adbd-c25f0c33c291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:20.048039 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c01ea8-57c2-49fa-adbd-c25f0c33c291 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:20.048337 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c01ea8-57c2-49fa-adbd-c25f0c33c291 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:20.048620 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c01ea8-57c2-49fa-adbd-c25f0c33c291 None admin] PATH_INFO: `/v3/roles` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:20.049476 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c01ea8-57c2-49fa-adbd-c25f0c33c291 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:20.049794 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c01ea8-57c2-49fa-adbd-c25f0c33c291 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:20.051288 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c01ea8-57c2-49fa-adbd-c25f0c33c291 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:20.060817 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 179/371] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 25 11:52:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:20.061792 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c01ea8-57c2-49fa-adbd-c25f0c33c291 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:20.075469 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f023565-45a6-4388-b633-3a34c00c00fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:20.077658 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f023565-45a6-4388-b633-3a34c00c00fe None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:20.136817 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:20.180260 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:20.192863 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c01ea8-57c2-49fa-adbd-c25f0c33c291 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:20.229649 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff3f632-f113-45bf-b90b-b8e29f18b871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:20.230338 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff3f632-f113-45bf-b90b-b8e29f18b871 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:20.230626 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff3f632-f113-45bf-b90b-b8e29f18b871 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:20.230911 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff3f632-f113-45bf-b90b-b8e29f18b871 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:20.231756 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff3f632-f113-45bf-b90b-b8e29f18b871 None admin] RBAC: Adding query filter params (group.id=1d3c5d1322fb40a68ec8f5172066c731, role.id=0bb7b8a3ae8f4d03a7f575ca8904963c, scope.project.id=fbdd1a23ea8a4df7ad5aa9fb346fe0da) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:20.232112 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff3f632-f113-45bf-b90b-b8e29f18b871 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:20.233762 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff3f632-f113-45bf-b90b-b8e29f18b871 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:20.240429 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 180/372] 10.222.0.44 () {56 vars in 1376 bytes} [Wed May 25 11:52:20 2022] GET /identity/v3/role_assignments?group.id=1d3c5d1322fb40a68ec8f5172066c731&scope.project.id=fbdd1a23ea8a4df7ad5aa9fb346fe0da&role.id=0bb7b8a3ae8f4d03a7f575ca8904963c => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:20.241254 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff3f632-f113-45bf-b90b-b8e29f18b871 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:20.253029 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 193/373] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 25 11:52:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 11:52:20.267818 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f023565-45a6-4388-b633-3a34c00c00fe None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:20.367451 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff3f632-f113-45bf-b90b-b8e29f18b871 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:20.404587 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f81c97-3ed3-4aea-9763-a587c5cc0fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:20.405270 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f81c97-3ed3-4aea-9763-a587c5cc0fad None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:20.405562 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f81c97-3ed3-4aea-9763-a587c5cc0fad None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:20.405843 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f81c97-3ed3-4aea-9763-a587c5cc0fad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:20.415366 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f023565-45a6-4388-b633-3a34c00c00fe None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:20.437531 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:20.460325 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c89b7-fb78-4ca0-a7a6-17e2f0a7d2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:20.461212 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c89b7-fb78-4ca0-a7a6-17e2f0a7d2c4 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:20.461497 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c89b7-fb78-4ca0-a7a6-17e2f0a7d2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:20.461773 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c89b7-fb78-4ca0-a7a6-17e2f0a7d2c4 None admin] PATH_INFO: `/v3/projects/fbdd1a23ea8a4df7ad5aa9fb346fe0da` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:20.463154 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c89b7-fb78-4ca0-a7a6-17e2f0a7d2c4 None admin] RBAC: Authorizing `identity:get_project(project_id=fbdd1a23ea8a4df7ad5aa9fb346fe0da)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:20.464690 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c89b7-fb78-4ca0-a7a6-17e2f0a7d2c4 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:20.466831 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 194/374] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 25 11:52:20 2022] GET /identity/v3/projects/fbdd1a23ea8a4df7ad5aa9fb346fe0da => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:52:20.473479 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c89b7-fb78-4ca0-a7a6-17e2f0a7d2c4 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:20.501766 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:20.511298 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f81c97-3ed3-4aea-9763-a587c5cc0fad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:20.512849 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f81c97-3ed3-4aea-9763-a587c5cc0fad None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:20.657472 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c89b7-fb78-4ca0-a7a6-17e2f0a7d2c4 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:20.676049 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 181/375] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 25 11:52:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 11:52:20.681956 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f81c97-3ed3-4aea-9763-a587c5cc0fad None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:20.713411 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be715d4a-5416-4fdd-b230-726e35063b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:20.717489 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be715d4a-5416-4fdd-b230-726e35063b9c None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:20.717848 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be715d4a-5416-4fdd-b230-726e35063b9c None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:20.718133 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be715d4a-5416-4fdd-b230-726e35063b9c None admin] PATH_INFO: `/v3/groups/1d3c5d1322fb40a68ec8f5172066c731` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:20.719371 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be715d4a-5416-4fdd-b230-726e35063b9c None admin] RBAC: Authorizing `identity:get_group(group_id=1d3c5d1322fb40a68ec8f5172066c731)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:20.720872 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be715d4a-5416-4fdd-b230-726e35063b9c None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:20.722508 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 195/376] 10.222.0.44 () {56 vars in 1180 bytes} [Wed May 25 11:52:20 2022] GET /identity/v3/groups/1d3c5d1322fb40a68ec8f5172066c731 => generated 226 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:52:20.746585 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be715d4a-5416-4fdd-b230-726e35063b9c None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:20.800258 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:20.878305 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f81c97-3ed3-4aea-9763-a587c5cc0fad None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:20.894622 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:20.929367 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be715d4a-5416-4fdd-b230-726e35063b9c None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:20.949792 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c889a-8eb9-4391-a236-d75884ca6b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:20.950683 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c889a-8eb9-4391-a236-d75884ca6b0b None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:20.950959 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c889a-8eb9-4391-a236-d75884ca6b0b None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:20.951250 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c889a-8eb9-4391-a236-d75884ca6b0b None admin] PATH_INFO: `/v3/projects/7103ef35356d4cd6a0f435bed6b1df47` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:20.955817 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904c889a-8eb9-4391-a236-d75884ca6b0b None admin] RBAC: Authorizing `identity:get_project(project_id=7103ef35356d4cd6a0f435bed6b1df47)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:20.955817 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904c889a-8eb9-4391-a236-d75884ca6b0b None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:20.957498 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 182/377] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 25 11:52:20 2022] GET /identity/v3/projects/7103ef35356d4cd6a0f435bed6b1df47 => generated 344 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:20.962807 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c889a-8eb9-4391-a236-d75884ca6b0b None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:20.990572 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d0cd06-a6b1-45af-8e67-e7a933cb6f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:20.991629 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0cd06-a6b1-45af-8e67-e7a933cb6f3a None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:20.992134 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0cd06-a6b1-45af-8e67-e7a933cb6f3a None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:20.992629 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0cd06-a6b1-45af-8e67-e7a933cb6f3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:20.993731 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d0cd06-a6b1-45af-8e67-e7a933cb6f3a None admin] RBAC: Adding query filter params (group.id=1d3c5d1322fb40a68ec8f5172066c731, role.id=1d75537a128747f180972029d0241cb4, scope.project.id=fbdd1a23ea8a4df7ad5aa9fb346fe0da) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:20.994292 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d0cd06-a6b1-45af-8e67-e7a933cb6f3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:20.996556 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d0cd06-a6b1-45af-8e67-e7a933cb6f3a None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:21.007971 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 196/378] 10.222.0.44 () {56 vars in 1376 bytes} [Wed May 25 11:52:20 2022] GET /identity/v3/role_assignments?group.id=1d3c5d1322fb40a68ec8f5172066c731&scope.project.id=fbdd1a23ea8a4df7ad5aa9fb346fe0da&role.id=1d75537a128747f180972029d0241cb4 => generated 260 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:52:21.103919 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c889a-8eb9-4391-a236-d75884ca6b0b None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:21.139831 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:21.149045 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa257d66-ceb3-4db0-9694-ad05672649b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:21.149942 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa257d66-ceb3-4db0-9694-ad05672649b0 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:21.150233 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa257d66-ceb3-4db0-9694-ad05672649b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:21.150517 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa257d66-ceb3-4db0-9694-ad05672649b0 None admin] PATH_INFO: `/v3/groups/173c6576ebe34a41a3066ad652b2f395` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:21.157839 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa257d66-ceb3-4db0-9694-ad05672649b0 None admin] RBAC: Authorizing `identity:get_group(group_id=173c6576ebe34a41a3066ad652b2f395)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:21.159328 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa257d66-ceb3-4db0-9694-ad05672649b0 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:21.161478 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 183/379] 10.222.0.44 () {56 vars in 1180 bytes} [Wed May 25 11:52:20 2022] GET /identity/v3/groups/173c6576ebe34a41a3066ad652b2f395 => generated 229 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:52:21.168932 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d0cd06-a6b1-45af-8e67-e7a933cb6f3a None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:21.290576 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d0cd06-a6b1-45af-8e67-e7a933cb6f3a None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:21.335487 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c298b-7791-459e-9ad8-0ddcee367517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:21.336192 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c298b-7791-459e-9ad8-0ddcee367517 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:21.336477 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c298b-7791-459e-9ad8-0ddcee367517 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:21.336756 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c298b-7791-459e-9ad8-0ddcee367517 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:21.337600 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c298b-7791-459e-9ad8-0ddcee367517 None admin] RBAC: Adding query filter params (group.id=173c6576ebe34a41a3066ad652b2f395, role.id=2fe5c1214bcc4c1bafa5a4545161518d, scope.project.id=7103ef35356d4cd6a0f435bed6b1df47) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:21.337913 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c298b-7791-459e-9ad8-0ddcee367517 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:21.339961 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c298b-7791-459e-9ad8-0ddcee367517 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:21.351536 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 197/380] 10.222.0.44 () {56 vars in 1376 bytes} [Wed May 25 11:52:21 2022] GET /identity/v3/role_assignments?group.id=173c6576ebe34a41a3066ad652b2f395&scope.project.id=7103ef35356d4cd6a0f435bed6b1df47&role.id=2fe5c1214bcc4c1bafa5a4545161518d => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:21.773404 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59d674-c5e7-4065-b7f5-9bf4f25ea2fa None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:21.773943 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59d674-c5e7-4065-b7f5-9bf4f25ea2fa None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:21.773943 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59d674-c5e7-4065-b7f5-9bf4f25ea2fa None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:21.775553 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 184/381] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:52:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:52:21.781579 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a2cab-4f89-4f74-97ac-0c38d5f9108e None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:21.782007 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a2cab-4f89-4f74-97ac-0c38d5f9108e None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:21.782186 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a2cab-4f89-4f74-97ac-0c38d5f9108e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:21.799529 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-590a2cab-4f89-4f74-97ac-0c38d5f9108e None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:52:21.805568 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-590a2cab-4f89-4f74-97ac-0c38d5f9108e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:52:21.806393 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:21.885598 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 198/382] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:52:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 11:52:21.911688 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee59d674-c5e7-4065-b7f5-9bf4f25ea2fa None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:22.025235 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee59d674-c5e7-4065-b7f5-9bf4f25ea2fa None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:22.062338 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f01e1b-5b5c-463e-bde1-a6f5b52a129b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:22.063150 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f01e1b-5b5c-463e-bde1-a6f5b52a129b None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:22.063438 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f01e1b-5b5c-463e-bde1-a6f5b52a129b None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:22.063716 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f01e1b-5b5c-463e-bde1-a6f5b52a129b None admin] PATH_INFO: `/v3/roles/member` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:22.075179 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f01e1b-5b5c-463e-bde1-a6f5b52a129b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:52:22.081103 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfebafa-602e-4b27-9853-6cdef58015d7 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:22.081389 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfebafa-602e-4b27-9853-6cdef58015d7 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:22.081671 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfebafa-602e-4b27-9853-6cdef58015d7 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:22.083164 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 199/383] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:52:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 11:52:22.086938 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-98f01e1b-5b5c-463e-bde1-a6f5b52a129b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 11:52:22.086938 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:22.086938 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:22.086938 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:22.086938 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:22.086938 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:22.086938 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:22.086938 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:22.086938 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:22.086938 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:22.086938 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:22.086938 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:22.086938 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:52:22.086938 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:52:22.086938 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:52:22.086938 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:52:22.087858 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:52:22.087858 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:52:22.087858 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:52:22.087858 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:52:22.087858 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:22.087858 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:22.087858 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:22.087858 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:22.087858 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:22.087858 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:22.087858 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:22.087858 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:52:22.087858 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:22.087858 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:22.087858 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:22.087858 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:22.088739 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:22.088739 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:22.088739 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:22.088739 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:22.088739 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:52:22.088739 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:52:22.088739 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:52:22.088739 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:52:22.088739 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:52:22.088739 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:52:22.088739 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 11:52:22.088739 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:52:22.088739 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 185/384] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 25 11:52:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:22.092482 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4ffff-1fc0-4de4-98d9-44f1f6c9f6bb None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:22.093014 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4ffff-1fc0-4de4-98d9-44f1f6c9f6bb None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:22.093498 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4ffff-1fc0-4de4-98d9-44f1f6c9f6bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:22.094588 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f01e1b-5b5c-463e-bde1-a6f5b52a129b None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:22.113130 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-56a4ffff-1fc0-4de4-98d9-44f1f6c9f6bb None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:52:22.114648 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-56a4ffff-1fc0-4de4-98d9-44f1f6c9f6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:52:22.158572 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:22.222156 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f01e1b-5b5c-463e-bde1-a6f5b52a129b None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:22.227697 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 200/385] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:52:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 11:52:22.265196 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae0ded7-f69e-4bda-9612-901b8196a1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:22.266239 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0ded7-f69e-4bda-9612-901b8196a1ba None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:22.266738 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0ded7-f69e-4bda-9612-901b8196a1ba None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:22.267205 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0ded7-f69e-4bda-9612-901b8196a1ba None admin] PATH_INFO: `/v3/roles` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:22.268194 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae0ded7-f69e-4bda-9612-901b8196a1ba None admin] RBAC: Adding query filter params (name=member) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:22.268848 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae0ded7-f69e-4bda-9612-901b8196a1ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:22.270420 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae0ded7-f69e-4bda-9612-901b8196a1ba None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:22.284814 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 186/386] 10.222.0.44 () {56 vars in 1101 bytes} [Wed May 25 11:52:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:52:22.292481 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a4ffff-1fc0-4de4-98d9-44f1f6c9f6bb None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:22.301100 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae0ded7-f69e-4bda-9612-901b8196a1ba None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:22.407245 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae0ded7-f69e-4bda-9612-901b8196a1ba None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:22.413187 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:22.424655 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:22.445784 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33e0cb-fd46-4da3-8210-255d9a5efdd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:22.446989 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33e0cb-fd46-4da3-8210-255d9a5efdd7 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:22.447553 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33e0cb-fd46-4da3-8210-255d9a5efdd7 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:22.448081 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33e0cb-fd46-4da3-8210-255d9a5efdd7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:22.459785 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d33e0cb-fd46-4da3-8210-255d9a5efdd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:52:22.469872 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-9d33e0cb-fd46-4da3-8210-255d9a5efdd7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 11:52:22.469872 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:22.469872 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:22.469872 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:22.469872 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:22.469872 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:22.469872 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:22.469872 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:22.469872 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:22.469872 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:22.469872 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:22.469872 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:22.469872 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:52:22.469872 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:52:22.469872 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:52:22.469872 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:52:22.470770 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:52:22.470770 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:52:22.470770 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:52:22.470770 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:52:22.470770 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:22.470770 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:22.470770 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:22.470770 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:22.470770 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:22.470770 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:22.470770 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:22.470770 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:52:22.470770 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:22.470770 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:22.470770 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:22.470770 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:22.471575 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:22.471575 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:22.471575 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:22.471575 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:22.471575 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:52:22.471575 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:52:22.471575 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:52:22.471575 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:52:22.471575 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:52:22.471575 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:52:22.471575 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 11:52:22.471575 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:52:22.472220 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a4ffff-1fc0-4de4-98d9-44f1f6c9f6bb None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:22.474319 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 187/387] 10.222.0.44 () {56 vars in 1114 bytes} [Wed May 25 11:52:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 11:52:22.480690 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33e0cb-fd46-4da3-8210-255d9a5efdd7 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:22.548585 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1422612-8578-48b3-80da-a7976a507b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:22.549721 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1422612-8578-48b3-80da-a7976a507b57 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:22.549721 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1422612-8578-48b3-80da-a7976a507b57 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:22.549995 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1422612-8578-48b3-80da-a7976a507b57 None admin] PATH_INFO: `/v3/groups/1d3c5d1322fb40a68ec8f5172066c731` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:22.551189 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1422612-8578-48b3-80da-a7976a507b57 None admin] RBAC: Authorizing `identity:get_group(group_id=1d3c5d1322fb40a68ec8f5172066c731)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:22.552628 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1422612-8578-48b3-80da-a7976a507b57 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:22.554619 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 201/388] 10.222.0.44 () {56 vars in 1180 bytes} [Wed May 25 11:52:22 2022] GET /identity/v3/groups/1d3c5d1322fb40a68ec8f5172066c731 => generated 226 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:22.560503 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1422612-8578-48b3-80da-a7976a507b57 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:22.649751 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33e0cb-fd46-4da3-8210-255d9a5efdd7 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:22.670822 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1422612-8578-48b3-80da-a7976a507b57 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:22.704968 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61c5ae-7949-4dfe-9671-f936baac0778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:22.705839 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61c5ae-7949-4dfe-9671-f936baac0778 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:22.706130 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61c5ae-7949-4dfe-9671-f936baac0778 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:22.706413 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61c5ae-7949-4dfe-9671-f936baac0778 None admin] PATH_INFO: `/v3/projects/0499f6b6a46a4da2bb2ceedf8b6843b6` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:22.707639 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d61c5ae-7949-4dfe-9671-f936baac0778 None admin] RBAC: Authorizing `identity:get_project(project_id=0499f6b6a46a4da2bb2ceedf8b6843b6)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:22.709366 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d61c5ae-7949-4dfe-9671-f936baac0778 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:22.711370 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 202/389] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 25 11:52:22 2022] GET /identity/v3/projects/0499f6b6a46a4da2bb2ceedf8b6843b6 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:52:22.720712 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61c5ae-7949-4dfe-9671-f936baac0778 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:22.732147 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:22.748519 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc3a4ea-39b6-4aea-88cf-4428d7939df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:22.749361 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3a4ea-39b6-4aea-88cf-4428d7939df3 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:22.749655 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3a4ea-39b6-4aea-88cf-4428d7939df3 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:22.749937 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3a4ea-39b6-4aea-88cf-4428d7939df3 None admin] PATH_INFO: `/v3/roles` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:22.750709 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc3a4ea-39b6-4aea-88cf-4428d7939df3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:22.751022 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc3a4ea-39b6-4aea-88cf-4428d7939df3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:22.752471 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc3a4ea-39b6-4aea-88cf-4428d7939df3 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:22.778734 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 188/390] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 25 11:52:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:52:22.786047 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc3a4ea-39b6-4aea-88cf-4428d7939df3 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:22.828503 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61c5ae-7949-4dfe-9671-f936baac0778 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:22.850439 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:22.863621 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378bc3b9-7db6-409f-8782-38e9fb3e131e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:22.864560 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378bc3b9-7db6-409f-8782-38e9fb3e131e None admin] REQUEST_METHOD: `PUT` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:22.864849 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378bc3b9-7db6-409f-8782-38e9fb3e131e None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:22.865133 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378bc3b9-7db6-409f-8782-38e9fb3e131e None admin] PATH_INFO: `/v3/projects/0499f6b6a46a4da2bb2ceedf8b6843b6/groups/1d3c5d1322fb40a68ec8f5172066c731/roles/0bb7b8a3ae8f4d03a7f575ca8904963c` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:22.867185 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378bc3b9-7db6-409f-8782-38e9fb3e131e None admin] RBAC: Authorizing `identity:create_grant(project_id=0499f6b6a46a4da2bb2ceedf8b6843b6, group_id=1d3c5d1322fb40a68ec8f5172066c731, role_id=0bb7b8a3ae8f4d03a7f575ca8904963c)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:22.868729 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378bc3b9-7db6-409f-8782-38e9fb3e131e None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:22.884660 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 203/391] 10.222.0.44 () {58 vars in 1442 bytes} [Wed May 25 11:52:22 2022] PUT /identity/v3/projects/0499f6b6a46a4da2bb2ceedf8b6843b6/groups/1d3c5d1322fb40a68ec8f5172066c731/roles/0bb7b8a3ae8f4d03a7f575ca8904963c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 11:52:22.972629 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e00bc9-cbdc-41f7-a327-79c862b40692 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:22.973276 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e00bc9-cbdc-41f7-a327-79c862b40692 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:22.973752 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e00bc9-cbdc-41f7-a327-79c862b40692 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:22.975549 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 204/392] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:52:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 11:52:22.981221 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd08276-71db-48e8-aa80-a867242eb72f None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:22.981832 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd08276-71db-48e8-aa80-a867242eb72f None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:22.982310 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd08276-71db-48e8-aa80-a867242eb72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:22.984902 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc3a4ea-39b6-4aea-88cf-4428d7939df3 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:23.000259 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-1dd08276-71db-48e8-aa80-a867242eb72f None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:52:23.002165 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-1dd08276-71db-48e8-aa80-a867242eb72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:52:23.057959 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7654bb-ff09-4788-aced-092f3fd71e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:23.059354 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7654bb-ff09-4788-aced-092f3fd71e45 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:23.059876 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7654bb-ff09-4788-aced-092f3fd71e45 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:23.060435 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7654bb-ff09-4788-aced-092f3fd71e45 None admin] PATH_INFO: `/v3/groups/1d3c5d1322fb40a68ec8f5172066c731` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:23.062398 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7654bb-ff09-4788-aced-092f3fd71e45 None admin] RBAC: Authorizing `identity:get_group(group_id=1d3c5d1322fb40a68ec8f5172066c731)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:23.066892 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7654bb-ff09-4788-aced-092f3fd71e45 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:23.069366 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 189/393] 10.222.0.44 () {56 vars in 1180 bytes} [Wed May 25 11:52:22 2022] GET /identity/v3/groups/1d3c5d1322fb40a68ec8f5172066c731 => generated 226 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:23.080764 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7654bb-ff09-4788-aced-092f3fd71e45 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:23.107285 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:23.131121 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 205/394] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:52:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 11:52:23.156130 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd08276-71db-48e8-aa80-a867242eb72f None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:23.224011 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7654bb-ff09-4788-aced-092f3fd71e45 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:23.237765 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:23.261799 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95320c15-19c9-45f9-afaa-60aa442d334e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:23.262834 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95320c15-19c9-45f9-afaa-60aa442d334e None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:23.263378 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95320c15-19c9-45f9-afaa-60aa442d334e None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:23.263760 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95320c15-19c9-45f9-afaa-60aa442d334e None admin] PATH_INFO: `/v3/projects/0499f6b6a46a4da2bb2ceedf8b6843b6` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:23.265099 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95320c15-19c9-45f9-afaa-60aa442d334e None admin] RBAC: Authorizing `identity:get_project(project_id=0499f6b6a46a4da2bb2ceedf8b6843b6)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:23.266672 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95320c15-19c9-45f9-afaa-60aa442d334e None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:23.268905 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 190/395] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 25 11:52:23 2022] GET /identity/v3/projects/0499f6b6a46a4da2bb2ceedf8b6843b6 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:23.274625 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95320c15-19c9-45f9-afaa-60aa442d334e None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:23.303863 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd08276-71db-48e8-aa80-a867242eb72f None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:23.372475 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c6f4a6-246f-45f4-8d51-ebfbbc8267b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:23.373197 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6f4a6-246f-45f4-8d51-ebfbbc8267b6 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:23.373481 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6f4a6-246f-45f4-8d51-ebfbbc8267b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:23.373756 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6f4a6-246f-45f4-8d51-ebfbbc8267b6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:23.386284 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95320c15-19c9-45f9-afaa-60aa442d334e None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:23.400832 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c6f4a6-246f-45f4-8d51-ebfbbc8267b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:52:23.411040 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-c8c6f4a6-246f-45f4-8d51-ebfbbc8267b6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 11:52:23.411040 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:23.411040 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:23.411040 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:23.411040 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:23.411040 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:23.411040 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:23.411040 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:23.411040 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:23.411040 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:23.411040 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:23.411040 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:23.411040 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:52:23.411040 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:52:23.411040 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:52:23.411040 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:52:23.411962 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:52:23.411962 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:52:23.411962 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:52:23.411962 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:52:23.411962 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:23.411962 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:23.411962 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:23.411962 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:23.411962 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:23.411962 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:23.411962 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:23.411962 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:52:23.411962 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:23.411962 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:23.411962 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:23.411962 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:23.412776 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:23.412776 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:23.412776 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:23.412776 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:23.412776 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:52:23.412776 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:52:23.412776 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:52:23.412776 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:52:23.412776 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:52:23.412776 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:52:23.412776 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 11:52:23.412776 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:52:23.412776 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 206/396] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 25 11:52:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 11:52:23.421210 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c6f4a6-246f-45f4-8d51-ebfbbc8267b6 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:23.449131 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1ba255-4b5d-44bf-8243-104a99c96e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:23.450022 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ba255-4b5d-44bf-8243-104a99c96e69 None admin] REQUEST_METHOD: `PUT` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:23.450306 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ba255-4b5d-44bf-8243-104a99c96e69 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:23.450585 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ba255-4b5d-44bf-8243-104a99c96e69 None admin] PATH_INFO: `/v3/projects/0499f6b6a46a4da2bb2ceedf8b6843b6/groups/1d3c5d1322fb40a68ec8f5172066c731/roles/1d75537a128747f180972029d0241cb4` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:23.453892 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1ba255-4b5d-44bf-8243-104a99c96e69 None admin] RBAC: Authorizing `identity:create_grant(project_id=0499f6b6a46a4da2bb2ceedf8b6843b6, group_id=1d3c5d1322fb40a68ec8f5172066c731, role_id=1d75537a128747f180972029d0241cb4)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:23.469069 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1ba255-4b5d-44bf-8243-104a99c96e69 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:23.494633 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 191/397] 10.222.0.44 () {58 vars in 1442 bytes} [Wed May 25 11:52:23 2022] PUT /identity/v3/projects/0499f6b6a46a4da2bb2ceedf8b6843b6/groups/1d3c5d1322fb40a68ec8f5172066c731/roles/1d75537a128747f180972029d0241cb4 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 11:52:23.524757 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:23.581869 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c6f4a6-246f-45f4-8d51-ebfbbc8267b6 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:23.617811 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380fdc4c-3d10-4535-adf1-8d187652258a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:23.618488 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380fdc4c-3d10-4535-adf1-8d187652258a None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:23.619087 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380fdc4c-3d10-4535-adf1-8d187652258a None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:23.619367 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380fdc4c-3d10-4535-adf1-8d187652258a None admin] PATH_INFO: `/v3/roles` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:23.620302 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380fdc4c-3d10-4535-adf1-8d187652258a None admin] RBAC: Adding query filter params (name=member) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:23.620614 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380fdc4c-3d10-4535-adf1-8d187652258a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:23.622048 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380fdc4c-3d10-4535-adf1-8d187652258a None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:23.632503 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 207/398] 10.222.0.44 () {56 vars in 1101 bytes} [Wed May 25 11:52:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:23.640956 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1ba255-4b5d-44bf-8243-104a99c96e69 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:23.685911 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:23.786271 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1ba255-4b5d-44bf-8243-104a99c96e69 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:23.833500 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d195149-f847-4410-820e-a1b3597042f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:23.834380 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d195149-f847-4410-820e-a1b3597042f8 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:23.834665 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d195149-f847-4410-820e-a1b3597042f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:23.834942 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d195149-f847-4410-820e-a1b3597042f8 None admin] PATH_INFO: `/v3/groups/1d3c5d1322fb40a68ec8f5172066c731` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:23.836962 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d195149-f847-4410-820e-a1b3597042f8 None admin] RBAC: Authorizing `identity:get_group(group_id=1d3c5d1322fb40a68ec8f5172066c731)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:23.838417 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d195149-f847-4410-820e-a1b3597042f8 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:23.841988 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 192/399] 10.222.0.44 () {56 vars in 1180 bytes} [Wed May 25 11:52:23 2022] GET /identity/v3/groups/1d3c5d1322fb40a68ec8f5172066c731 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:23.846568 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380fdc4c-3d10-4535-adf1-8d187652258a None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:23.983761 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380fdc4c-3d10-4535-adf1-8d187652258a None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:24.003261 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:24.022111 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d0a88f-0197-407b-8131-85e94c0eba1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:24.022987 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0a88f-0197-407b-8131-85e94c0eba1a None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:24.023268 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0a88f-0197-407b-8131-85e94c0eba1a None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:24.023542 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0a88f-0197-407b-8131-85e94c0eba1a None admin] PATH_INFO: `/v3/projects/fbdd1a23ea8a4df7ad5aa9fb346fe0da` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:24.024769 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d0a88f-0197-407b-8131-85e94c0eba1a None admin] RBAC: Authorizing `identity:get_project(project_id=fbdd1a23ea8a4df7ad5aa9fb346fe0da)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:24.026350 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d0a88f-0197-407b-8131-85e94c0eba1a None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:24.030938 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 208/400] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 25 11:52:23 2022] GET /identity/v3/projects/fbdd1a23ea8a4df7ad5aa9fb346fe0da => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:24.034385 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d195149-f847-4410-820e-a1b3597042f8 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:24.145930 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:24.155318 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d195149-f847-4410-820e-a1b3597042f8 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:24.195531 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ed7d0a-2c06-4f59-8217-92e295723b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:24.196464 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed7d0a-2c06-4f59-8217-92e295723b26 None admin] REQUEST_METHOD: `PUT` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:24.196751 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed7d0a-2c06-4f59-8217-92e295723b26 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:24.197029 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed7d0a-2c06-4f59-8217-92e295723b26 None admin] PATH_INFO: `/v3/projects/fbdd1a23ea8a4df7ad5aa9fb346fe0da/groups/1d3c5d1322fb40a68ec8f5172066c731/roles/0bb7b8a3ae8f4d03a7f575ca8904963c` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:24.199586 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ed7d0a-2c06-4f59-8217-92e295723b26 None admin] RBAC: Authorizing `identity:create_grant(project_id=fbdd1a23ea8a4df7ad5aa9fb346fe0da, group_id=1d3c5d1322fb40a68ec8f5172066c731, role_id=0bb7b8a3ae8f4d03a7f575ca8904963c)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:24.201144 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ed7d0a-2c06-4f59-8217-92e295723b26 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:24.218909 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 193/401] 10.222.0.44 () {58 vars in 1442 bytes} [Wed May 25 11:52:24 2022] PUT /identity/v3/projects/fbdd1a23ea8a4df7ad5aa9fb346fe0da/groups/1d3c5d1322fb40a68ec8f5172066c731/roles/0bb7b8a3ae8f4d03a7f575ca8904963c => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 11:52:24.329631 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9f6db-557a-4cd9-aa62-f602721d9f2d None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:24.329925 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9f6db-557a-4cd9-aa62-f602721d9f2d None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:24.330118 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9f6db-557a-4cd9-aa62-f602721d9f2d None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:24.331872 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 209/402] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:52:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:52:24.337777 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2741e59-14c5-4470-9a02-ef7c5489e2d8 None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:24.338103 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2741e59-14c5-4470-9a02-ef7c5489e2d8 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:24.338354 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2741e59-14c5-4470-9a02-ef7c5489e2d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:24.356850 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-a2741e59-14c5-4470-9a02-ef7c5489e2d8 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:52:24.358081 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-a2741e59-14c5-4470-9a02-ef7c5489e2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:52:24.454689 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 194/403] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:52:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 11:52:24.484704 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa9f6db-557a-4cd9-aa62-f602721d9f2d None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:24.577480 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b040d17-50c2-48c9-a1c7-db6613ada4b3 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:24.577804 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b040d17-50c2-48c9-a1c7-db6613ada4b3 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:24.578056 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b040d17-50c2-48c9-a1c7-db6613ada4b3 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:24.579544 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 195/404] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:52:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 11:52:24.584817 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ff8af-c556-42a7-abcb-5f8040d19024 None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:24.585456 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ff8af-c556-42a7-abcb-5f8040d19024 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:24.585962 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ff8af-c556-42a7-abcb-5f8040d19024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:24.607386 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-994ff8af-c556-42a7-abcb-5f8040d19024 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:52:24.611377 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-994ff8af-c556-42a7-abcb-5f8040d19024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:52:24.633343 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa9f6db-557a-4cd9-aa62-f602721d9f2d None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:24.697179 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c3f743-3982-495f-a10a-5848e84eadfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:24.698967 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3f743-3982-495f-a10a-5848e84eadfd None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:24.699484 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3f743-3982-495f-a10a-5848e84eadfd None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:24.701365 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3f743-3982-495f-a10a-5848e84eadfd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:24.722035 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c3f743-3982-495f-a10a-5848e84eadfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:52:24.737357 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-68c3f743-3982-495f-a10a-5848e84eadfd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 11:52:24.737357 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:24.737357 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:24.737357 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:24.737357 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:24.737357 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:24.737357 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:24.737357 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:24.737357 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:24.737357 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:24.737357 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:24.737357 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:24.737357 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:52:24.737357 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:52:24.737357 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:52:24.737357 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:52:24.738246 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:52:24.738246 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:52:24.738246 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:52:24.738246 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:52:24.738246 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:24.738246 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:24.738246 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:24.738246 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:24.738246 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:24.738246 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:24.738246 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:24.738246 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:52:24.738246 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:24.738246 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:24.738246 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:24.738246 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:24.739082 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:24.739082 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:24.739082 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:24.739082 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:24.739082 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:52:24.739082 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:52:24.739082 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:52:24.739082 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:52:24.739082 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:52:24.739082 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:52:24.739082 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 11:52:24.739082 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:52:24.744769 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 196/405] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:52:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 11:52:24.745191 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 210/406] 10.222.0.44 () {56 vars in 1114 bytes} [Wed May 25 11:52:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:24.752918 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ff8af-c556-42a7-abcb-5f8040d19024 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:24.782391 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:24.796904 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c3f743-3982-495f-a10a-5848e84eadfd None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:24.862655 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:24.927496 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ff8af-c556-42a7-abcb-5f8040d19024 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:24.953876 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c3f743-3982-495f-a10a-5848e84eadfd None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:24.967876 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c700aa-e45d-4ae5-88d9-f1d0a8b9c68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:24.968565 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c700aa-e45d-4ae5-88d9-f1d0a8b9c68a None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:24.968854 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c700aa-e45d-4ae5-88d9-f1d0a8b9c68a None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:24.969131 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c700aa-e45d-4ae5-88d9-f1d0a8b9c68a None admin] PATH_INFO: `/v3/roles` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:24.969881 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c700aa-e45d-4ae5-88d9-f1d0a8b9c68a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:24.970193 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c700aa-e45d-4ae5-88d9-f1d0a8b9c68a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:24.971574 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c700aa-e45d-4ae5-88d9-f1d0a8b9c68a None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:24.983157 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 197/407] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 25 11:52:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:24.989881 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c700aa-e45d-4ae5-88d9-f1d0a8b9c68a None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:25.026915 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f866977e-9879-4411-964d-dda480f1d996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:25.027994 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866977e-9879-4411-964d-dda480f1d996 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:25.028282 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866977e-9879-4411-964d-dda480f1d996 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:25.031023 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866977e-9879-4411-964d-dda480f1d996 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:25.056871 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f866977e-9879-4411-964d-dda480f1d996 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:52:25.064946 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-f866977e-9879-4411-964d-dda480f1d996 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 11:52:25.064946 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:25.064946 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:25.064946 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:25.064946 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:25.064946 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:25.064946 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:25.064946 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:25.064946 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:25.064946 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:25.064946 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:25.064946 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:25.064946 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:52:25.064946 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:52:25.064946 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:52:25.064946 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:52:25.065856 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:52:25.065856 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:52:25.065856 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:52:25.065856 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:52:25.065856 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:25.065856 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:25.065856 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:25.065856 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:25.065856 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:25.065856 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:25.065856 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:25.065856 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:52:25.065856 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:25.065856 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:25.065856 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:25.065856 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:25.067072 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:25.067072 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:25.067072 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:25.067072 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:25.067072 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:52:25.067072 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:52:25.067072 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:52:25.067072 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:52:25.067072 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:52:25.067072 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:52:25.067072 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 11:52:25.067072 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:52:25.067072 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 211/408] 10.222.0.44 () {56 vars in 1096 bytes} [Wed May 25 11:52:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:25.073892 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f866977e-9879-4411-964d-dda480f1d996 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:25.116136 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:25.139414 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c700aa-e45d-4ae5-88d9-f1d0a8b9c68a None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:25.187831 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741fbc5-89ab-46f8-bf7a-e7fbd19a03fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:25.187831 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741fbc5-89ab-46f8-bf7a-e7fbd19a03fe None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:25.188053 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741fbc5-89ab-46f8-bf7a-e7fbd19a03fe None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:25.188308 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741fbc5-89ab-46f8-bf7a-e7fbd19a03fe None admin] PATH_INFO: `/v3/groups/1d3c5d1322fb40a68ec8f5172066c731` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:25.191178 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2741fbc5-89ab-46f8-bf7a-e7fbd19a03fe None admin] RBAC: Authorizing `identity:get_group(group_id=1d3c5d1322fb40a68ec8f5172066c731)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:25.194260 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2741fbc5-89ab-46f8-bf7a-e7fbd19a03fe None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:25.195931 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 198/409] 10.222.0.44 () {56 vars in 1180 bytes} [Wed May 25 11:52:24 2022] GET /identity/v3/groups/1d3c5d1322fb40a68ec8f5172066c731 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:52:25.202491 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741fbc5-89ab-46f8-bf7a-e7fbd19a03fe None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:25.303415 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f866977e-9879-4411-964d-dda480f1d996 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:25.310457 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:25.367918 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741fbc5-89ab-46f8-bf7a-e7fbd19a03fe None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:25.406423 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c19fa37-c75f-44cc-ab14-371725ef31fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:25.407295 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19fa37-c75f-44cc-ab14-371725ef31fc None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:25.407580 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19fa37-c75f-44cc-ab14-371725ef31fc None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:25.407875 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19fa37-c75f-44cc-ab14-371725ef31fc None admin] PATH_INFO: `/v3/projects/fbdd1a23ea8a4df7ad5aa9fb346fe0da` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:25.409420 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c19fa37-c75f-44cc-ab14-371725ef31fc None admin] RBAC: Authorizing `identity:get_project(project_id=fbdd1a23ea8a4df7ad5aa9fb346fe0da)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:25.410864 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c19fa37-c75f-44cc-ab14-371725ef31fc None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:25.412768 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 199/410] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 25 11:52:25 2022] GET /identity/v3/projects/fbdd1a23ea8a4df7ad5aa9fb346fe0da => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:25.418457 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c19fa37-c75f-44cc-ab14-371725ef31fc None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:25.420574 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c0978-92d4-42eb-a0f2-2814b51d8331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:25.421256 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c0978-92d4-42eb-a0f2-2814b51d8331 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:25.421542 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c0978-92d4-42eb-a0f2-2814b51d8331 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:25.421822 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c0978-92d4-42eb-a0f2-2814b51d8331 None admin] PATH_INFO: `/v3/roles` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:25.422578 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7c0978-92d4-42eb-a0f2-2814b51d8331 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:25.422895 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7c0978-92d4-42eb-a0f2-2814b51d8331 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:25.424305 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7c0978-92d4-42eb-a0f2-2814b51d8331 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:25.445161 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 212/411] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 25 11:52:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:52:25.450575 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c0978-92d4-42eb-a0f2-2814b51d8331 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:25.464558 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:25.577447 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c0978-92d4-42eb-a0f2-2814b51d8331 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:25.628399 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c399f524-6ab0-4497-b088-5f6b8d0f9832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:25.629184 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399f524-6ab0-4497-b088-5f6b8d0f9832 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:25.629472 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399f524-6ab0-4497-b088-5f6b8d0f9832 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:25.629756 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399f524-6ab0-4497-b088-5f6b8d0f9832 None admin] PATH_INFO: `/v3/groups/173c6576ebe34a41a3066ad652b2f395` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:25.632243 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c399f524-6ab0-4497-b088-5f6b8d0f9832 None admin] RBAC: Authorizing `identity:get_group(group_id=173c6576ebe34a41a3066ad652b2f395)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:25.636157 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c399f524-6ab0-4497-b088-5f6b8d0f9832 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:25.641573 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 213/412] 10.222.0.44 () {56 vars in 1180 bytes} [Wed May 25 11:52:25 2022] GET /identity/v3/groups/173c6576ebe34a41a3066ad652b2f395 => generated 229 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:52:25.643549 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c399f524-6ab0-4497-b088-5f6b8d0f9832 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:25.650500 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c19fa37-c75f-44cc-ab14-371725ef31fc None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:25.716204 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:25.756216 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2695973c-085e-4d75-9edf-48972278c714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:25.757114 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695973c-085e-4d75-9edf-48972278c714 None admin] REQUEST_METHOD: `PUT` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:25.757400 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695973c-085e-4d75-9edf-48972278c714 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:25.757678 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695973c-085e-4d75-9edf-48972278c714 None admin] PATH_INFO: `/v3/projects/fbdd1a23ea8a4df7ad5aa9fb346fe0da/groups/1d3c5d1322fb40a68ec8f5172066c731/roles/1d75537a128747f180972029d0241cb4` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:25.762925 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2695973c-085e-4d75-9edf-48972278c714 None admin] RBAC: Authorizing `identity:create_grant(project_id=fbdd1a23ea8a4df7ad5aa9fb346fe0da, group_id=1d3c5d1322fb40a68ec8f5172066c731, role_id=1d75537a128747f180972029d0241cb4)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:25.764426 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2695973c-085e-4d75-9edf-48972278c714 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:25.791290 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 200/413] 10.222.0.44 () {58 vars in 1442 bytes} [Wed May 25 11:52:25 2022] PUT /identity/v3/projects/fbdd1a23ea8a4df7ad5aa9fb346fe0da/groups/1d3c5d1322fb40a68ec8f5172066c731/roles/1d75537a128747f180972029d0241cb4 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 11:52:25.795421 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c399f524-6ab0-4497-b088-5f6b8d0f9832 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:25.845617 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c532ab6-1deb-44cb-8da1-be29a11c5e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:25.846654 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c532ab6-1deb-44cb-8da1-be29a11c5e0a None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:25.846948 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c532ab6-1deb-44cb-8da1-be29a11c5e0a None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:25.847230 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c532ab6-1deb-44cb-8da1-be29a11c5e0a None admin] PATH_INFO: `/v3/projects/7103ef35356d4cd6a0f435bed6b1df47` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:25.848536 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c532ab6-1deb-44cb-8da1-be29a11c5e0a None admin] RBAC: Authorizing `identity:get_project(project_id=7103ef35356d4cd6a0f435bed6b1df47)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:25.850008 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c532ab6-1deb-44cb-8da1-be29a11c5e0a None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:25.852278 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 214/414] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 25 11:52:25 2022] GET /identity/v3/projects/7103ef35356d4cd6a0f435bed6b1df47 => generated 344 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:25.860980 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2695973c-085e-4d75-9edf-48972278c714 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:25.919965 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf0da2-081e-4cea-a8c6-0a538cc8a174 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:25.919965 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf0da2-081e-4cea-a8c6-0a538cc8a174 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:25.919965 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf0da2-081e-4cea-a8c6-0a538cc8a174 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:25.919965 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 215/415] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:52:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 11:52:25.929756 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27107a9-8d81-49a0-941d-103e3c2b1caf None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:25.930369 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27107a9-8d81-49a0-941d-103e3c2b1caf None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:25.930878 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27107a9-8d81-49a0-941d-103e3c2b1caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:25.965858 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-c27107a9-8d81-49a0-941d-103e3c2b1caf None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:52:25.967095 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-c27107a9-8d81-49a0-941d-103e3c2b1caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:52:26.006306 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:26.033697 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2695973c-085e-4d75-9edf-48972278c714 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:26.077585 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21315146-734e-44e2-a1cb-3a4ea0b5c803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:26.078571 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21315146-734e-44e2-a1cb-3a4ea0b5c803 None admin] REQUEST_METHOD: `PUT` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:26.078930 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21315146-734e-44e2-a1cb-3a4ea0b5c803 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:26.079280 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21315146-734e-44e2-a1cb-3a4ea0b5c803 None admin] PATH_INFO: `/v3/projects/7103ef35356d4cd6a0f435bed6b1df47/groups/173c6576ebe34a41a3066ad652b2f395/roles/2fe5c1214bcc4c1bafa5a4545161518d` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:26.079997 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 216/416] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:52:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 11:52:26.081645 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21315146-734e-44e2-a1cb-3a4ea0b5c803 None admin] RBAC: Authorizing `identity:create_grant(project_id=7103ef35356d4cd6a0f435bed6b1df47, group_id=173c6576ebe34a41a3066ad652b2f395, role_id=2fe5c1214bcc4c1bafa5a4545161518d)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:26.083086 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21315146-734e-44e2-a1cb-3a4ea0b5c803 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:26.103651 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 201/417] 10.222.0.44 () {58 vars in 1442 bytes} [Wed May 25 11:52:25 2022] PUT /identity/v3/projects/7103ef35356d4cd6a0f435bed6b1df47/groups/173c6576ebe34a41a3066ad652b2f395/roles/2fe5c1214bcc4c1bafa5a4545161518d => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 11:52:26.115181 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27107a9-8d81-49a0-941d-103e3c2b1caf None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:26.151952 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:26.255600 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27107a9-8d81-49a0-941d-103e3c2b1caf None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:26.311396 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae6bc1-6d9a-4291-834f-d2ac39ac4a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:26.312255 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae6bc1-6d9a-4291-834f-d2ac39ac4a92 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:26.312541 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae6bc1-6d9a-4291-834f-d2ac39ac4a92 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:26.312816 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae6bc1-6d9a-4291-834f-d2ac39ac4a92 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:26.325209 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae6bc1-6d9a-4291-834f-d2ac39ac4a92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:52:26.333325 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-02ae6bc1-6d9a-4291-834f-d2ac39ac4a92 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 11:52:26.333325 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:26.333325 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:26.333325 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:26.333325 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:26.333325 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:26.333325 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:26.333325 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:26.333325 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:26.333325 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:26.333325 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:26.333325 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:26.333325 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:52:26.333325 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:52:26.333325 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:52:26.333325 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:52:26.334302 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:52:26.334302 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:52:26.334302 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:52:26.334302 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:52:26.334302 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:26.334302 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:26.334302 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:26.334302 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:26.334302 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:26.334302 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:26.334302 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:26.334302 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:52:26.334302 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:26.334302 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:26.334302 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:26.334302 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:26.335098 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:26.335098 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:26.335098 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:26.335098 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:26.335098 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:52:26.335098 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:52:26.335098 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:52:26.335098 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:52:26.335098 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:52:26.335098 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:52:26.335098 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 11:52:26.335098 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:52:26.335098 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 217/418] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 25 11:52:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:26.341016 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21315146-734e-44e2-a1cb-3a4ea0b5c803 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:26.445812 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6d1e2-0e53-4902-8ae5-d25f7ccb9dae None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:26.446102 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6d1e2-0e53-4902-8ae5-d25f7ccb9dae None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:26.446289 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6d1e2-0e53-4902-8ae5-d25f7ccb9dae None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:26.447769 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 218/419] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:52:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 11:52:26.454273 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56b9af-fc9a-46cd-93ca-4fc231826167 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:26.454574 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56b9af-fc9a-46cd-93ca-4fc231826167 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:26.454975 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56b9af-fc9a-46cd-93ca-4fc231826167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:26.476621 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21315146-734e-44e2-a1cb-3a4ea0b5c803 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:26.478853 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-fb56b9af-fc9a-46cd-93ca-4fc231826167 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:52:26.481623 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-fb56b9af-fc9a-46cd-93ca-4fc231826167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:52:26.526524 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9895ddf2-ebdd-4b78-9361-b67e9833bb98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:26.529643 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9895ddf2-ebdd-4b78-9361-b67e9833bb98 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:26.530117 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9895ddf2-ebdd-4b78-9361-b67e9833bb98 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:26.530577 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9895ddf2-ebdd-4b78-9361-b67e9833bb98 None admin] PATH_INFO: `/v3/roles` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:26.531605 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9895ddf2-ebdd-4b78-9361-b67e9833bb98 None admin] RBAC: Adding query filter params (name=member) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:26.533914 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9895ddf2-ebdd-4b78-9361-b67e9833bb98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:26.535760 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9895ddf2-ebdd-4b78-9361-b67e9833bb98 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:26.546745 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:26.554634 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 202/420] 10.222.0.44 () {56 vars in 1101 bytes} [Wed May 25 11:52:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:26.561190 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9895ddf2-ebdd-4b78-9361-b67e9833bb98 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:26.630840 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 219/421] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:52:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 11:52:26.657405 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb56b9af-fc9a-46cd-93ca-4fc231826167 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:26.695266 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:26.768711 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9895ddf2-ebdd-4b78-9361-b67e9833bb98 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:26.843490 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e08610b-655e-4da0-8f45-42680dbb681a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:26.844563 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08610b-655e-4da0-8f45-42680dbb681a None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:26.845072 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08610b-655e-4da0-8f45-42680dbb681a None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:26.845274 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb56b9af-fc9a-46cd-93ca-4fc231826167 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:26.845784 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08610b-655e-4da0-8f45-42680dbb681a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:26.909650 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaeff47-e9f6-435e-8bb5-2948b846862c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:26.910471 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaeff47-e9f6-435e-8bb5-2948b846862c None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:26.910755 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaeff47-e9f6-435e-8bb5-2948b846862c None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:26.911032 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaeff47-e9f6-435e-8bb5-2948b846862c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:26.928174 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaeff47-e9f6-435e-8bb5-2948b846862c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:52:26.936991 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-caaeff47-e9f6-435e-8bb5-2948b846862c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 11:52:26.936991 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:26.936991 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:26.936991 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:26.936991 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:26.936991 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:26.936991 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:26.936991 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:26.936991 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:26.936991 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:26.936991 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:26.936991 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:26.936991 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:52:26.936991 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:52:26.936991 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:52:26.936991 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:52:26.937934 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:52:26.937934 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:52:26.937934 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:52:26.937934 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:52:26.937934 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:26.937934 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:26.937934 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:26.937934 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:26.937934 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:26.937934 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:26.937934 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:26.937934 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:52:26.937934 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:26.937934 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:26.937934 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:26.937934 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:26.939467 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:26.939467 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:26.939467 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:26.939467 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:26.939467 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:52:26.939467 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:52:26.939467 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:52:26.939467 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:52:26.939467 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:52:26.939467 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:52:26.939467 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 11:52:26.939467 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:52:26.939467 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 220/422] 10.222.0.44 () {56 vars in 1114 bytes} [Wed May 25 11:52:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 11:52:26.939467 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4699fbb-8cfc-45b6-9114-0c6effb05c7e None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:26.940208 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4699fbb-8cfc-45b6-9114-0c6effb05c7e None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:26.940208 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4699fbb-8cfc-45b6-9114-0c6effb05c7e None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:26.941356 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 221/423] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:52:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:52:26.944274 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4699fbb-8cfc-45b6-9114-0c6effb05c7e None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:26.957659 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:26.960765 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e08610b-655e-4da0-8f45-42680dbb681a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:26.962540 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e08610b-655e-4da0-8f45-42680dbb681a None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:27.041178 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:27.063028 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4699fbb-8cfc-45b6-9114-0c6effb05c7e None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:27.083019 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 203/424] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 25 11:52:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 11:52:27.085523 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdfea3f-94ef-43a9-87a7-4f079a00f810 None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:27.086022 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdfea3f-94ef-43a9-87a7-4f079a00f810 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:27.086750 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdfea3f-94ef-43a9-87a7-4f079a00f810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:27.100156 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ea299-5d21-48dc-9812-f3605a4d50f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:27.100828 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ea299-5d21-48dc-9812-f3605a4d50f8 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:27.101112 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ea299-5d21-48dc-9812-f3605a4d50f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:27.101445 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ea299-5d21-48dc-9812-f3605a4d50f8 None admin] PATH_INFO: `/v3/roles` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:27.102196 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0ea299-5d21-48dc-9812-f3605a4d50f8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:27.102560 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0ea299-5d21-48dc-9812-f3605a4d50f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:27.107975 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0ea299-5d21-48dc-9812-f3605a4d50f8 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:27.114351 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-8bdfea3f-94ef-43a9-87a7-4f079a00f810 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:52:27.115657 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-8bdfea3f-94ef-43a9-87a7-4f079a00f810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:52:27.116071 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 222/425] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 25 11:52:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:27.117049 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ea299-5d21-48dc-9812-f3605a4d50f8 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:27.195816 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 204/426] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:52:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 11:52:27.195816 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdfea3f-94ef-43a9-87a7-4f079a00f810 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:27.221082 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:27.255414 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ea299-5d21-48dc-9812-f3605a4d50f8 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:27.294071 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabbb29d-c805-4ae7-a123-e8de16544199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:27.295209 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabbb29d-c805-4ae7-a123-e8de16544199 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:27.295759 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabbb29d-c805-4ae7-a123-e8de16544199 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:27.296290 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabbb29d-c805-4ae7-a123-e8de16544199 None admin] PATH_INFO: `/v3/projects/0499f6b6a46a4da2bb2ceedf8b6843b6` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:27.297746 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabbb29d-c805-4ae7-a123-e8de16544199 None admin] RBAC: Authorizing `identity:get_project(project_id=0499f6b6a46a4da2bb2ceedf8b6843b6)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:27.299356 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabbb29d-c805-4ae7-a123-e8de16544199 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:27.299595 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdfea3f-94ef-43a9-87a7-4f079a00f810 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:27.301928 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 223/427] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 25 11:52:27 2022] GET /identity/v3/projects/0499f6b6a46a4da2bb2ceedf8b6843b6 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:27.302877 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabbb29d-c805-4ae7-a123-e8de16544199 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:27.319101 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:27.335141 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685bf0f-3096-47ae-b948-0637ffc96336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:27.335898 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685bf0f-3096-47ae-b948-0637ffc96336 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:27.336439 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685bf0f-3096-47ae-b948-0637ffc96336 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:27.336563 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685bf0f-3096-47ae-b948-0637ffc96336 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:27.405334 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0685bf0f-3096-47ae-b948-0637ffc96336 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:27.406907 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0685bf0f-3096-47ae-b948-0637ffc96336 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:27.416103 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabbb29d-c805-4ae7-a123-e8de16544199 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:27.436758 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:27.455825 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c7fc8-ecc4-4866-8ba4-a7388dae8cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:27.456996 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c7fc8-ecc4-4866-8ba4-a7388dae8cd0 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:27.457515 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c7fc8-ecc4-4866-8ba4-a7388dae8cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:27.458000 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c7fc8-ecc4-4866-8ba4-a7388dae8cd0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:27.469719 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c7fc8-ecc4-4866-8ba4-a7388dae8cd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:52:27.478298 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-390c7fc8-ecc4-4866-8ba4-a7388dae8cd0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 11:52:27.478298 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:27.478298 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:27.478298 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:27.478298 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:27.478298 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:27.478298 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:27.478298 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:27.478298 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:27.478298 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:27.478298 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:27.478298 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:27.478298 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:52:27.478298 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:52:27.478298 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:52:27.478298 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:52:27.479761 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:52:27.479761 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:52:27.479761 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:52:27.479761 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:52:27.479761 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:27.479761 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:27.479761 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:27.479761 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:27.479761 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:27.479761 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:27.479761 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:27.479761 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:52:27.479761 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:27.479761 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:27.479761 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:27.479761 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:27.480705 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:27.480705 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:27.480705 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:27.480705 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:27.480705 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:52:27.480705 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:52:27.480705 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:52:27.480705 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:52:27.480705 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:52:27.480705 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:52:27.480705 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 11:52:27.480705 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:52:27.483141 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 224/428] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 25 11:52:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:27.484161 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c7fc8-ecc4-4866-8ba4-a7388dae8cd0 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:27.518081 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 205/429] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 25 11:52:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 11:52:27.519311 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685bf0f-3096-47ae-b948-0637ffc96336 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:27.567433 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:27.601773 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c7fc8-ecc4-4866-8ba4-a7388dae8cd0 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:27.627387 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685bf0f-3096-47ae-b948-0637ffc96336 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:27.642302 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0883b04c-c68e-494e-a354-91ad129d19f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:27.643546 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883b04c-c68e-494e-a354-91ad129d19f4 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:27.644059 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883b04c-c68e-494e-a354-91ad129d19f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:27.644517 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883b04c-c68e-494e-a354-91ad129d19f4 None admin] PATH_INFO: `/v3/groups/1d3c5d1322fb40a68ec8f5172066c731` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:27.646069 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0883b04c-c68e-494e-a354-91ad129d19f4 None admin] RBAC: Authorizing `identity:get_group(group_id=1d3c5d1322fb40a68ec8f5172066c731)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:27.648264 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0883b04c-c68e-494e-a354-91ad129d19f4 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:27.650518 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 225/430] 10.222.0.44 () {56 vars in 1180 bytes} [Wed May 25 11:52:27 2022] GET /identity/v3/groups/1d3c5d1322fb40a68ec8f5172066c731 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:27.651538 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0883b04c-c68e-494e-a354-91ad129d19f4 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:27.659367 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:27.665218 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da01206e-b747-4cc2-aa97-83b256a27311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:27.665992 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01206e-b747-4cc2-aa97-83b256a27311 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:27.667178 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01206e-b747-4cc2-aa97-83b256a27311 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:27.667687 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01206e-b747-4cc2-aa97-83b256a27311 None admin] PATH_INFO: `/v3/roles` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:27.668774 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da01206e-b747-4cc2-aa97-83b256a27311 None admin] RBAC: Adding query filter params (name=member) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:27.669312 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da01206e-b747-4cc2-aa97-83b256a27311 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:27.671125 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da01206e-b747-4cc2-aa97-83b256a27311 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:27.685130 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 206/431] 10.222.0.44 () {56 vars in 1101 bytes} [Wed May 25 11:52:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:27.686109 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da01206e-b747-4cc2-aa97-83b256a27311 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:27.766024 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0883b04c-c68e-494e-a354-91ad129d19f4 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:27.788770 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da01206e-b747-4cc2-aa97-83b256a27311 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:27.805628 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4fce2-1f45-4e39-910f-c9214827aae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:27.806967 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4fce2-1f45-4e39-910f-c9214827aae7 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:27.807694 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4fce2-1f45-4e39-910f-c9214827aae7 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:27.808274 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4fce2-1f45-4e39-910f-c9214827aae7 None admin] PATH_INFO: `/v3/projects/0499f6b6a46a4da2bb2ceedf8b6843b6` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:27.810124 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd4fce2-1f45-4e39-910f-c9214827aae7 None admin] RBAC: Authorizing `identity:get_project(project_id=0499f6b6a46a4da2bb2ceedf8b6843b6)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:27.811993 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd4fce2-1f45-4e39-910f-c9214827aae7 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:27.813950 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 226/432] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 25 11:52:27 2022] GET /identity/v3/projects/0499f6b6a46a4da2bb2ceedf8b6843b6 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:27.815050 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4fce2-1f45-4e39-910f-c9214827aae7 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:27.827052 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4275641d-c155-4fed-9014-7045678557d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:27.827645 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275641d-c155-4fed-9014-7045678557d4 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:27.827958 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275641d-c155-4fed-9014-7045678557d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:27.828239 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275641d-c155-4fed-9014-7045678557d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:27.829132 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4275641d-c155-4fed-9014-7045678557d4 None admin] RBAC: Adding query filter params (group.id=1d3c5d1322fb40a68ec8f5172066c731, role.id=0bb7b8a3ae8f4d03a7f575ca8904963c, scope.project.id=0499f6b6a46a4da2bb2ceedf8b6843b6) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:27.829444 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4275641d-c155-4fed-9014-7045678557d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:27.830929 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4275641d-c155-4fed-9014-7045678557d4 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:27.832572 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:27.838062 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 207/433] 10.222.0.44 () {56 vars in 1376 bytes} [Wed May 25 11:52:27 2022] GET /identity/v3/role_assignments?group.id=1d3c5d1322fb40a68ec8f5172066c731&scope.project.id=0499f6b6a46a4da2bb2ceedf8b6843b6&role.id=0bb7b8a3ae8f4d03a7f575ca8904963c => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:27.839616 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4275641d-c155-4fed-9014-7045678557d4 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:27.907964 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:27.941502 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4fce2-1f45-4e39-910f-c9214827aae7 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:27.955113 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4275641d-c155-4fed-9014-7045678557d4 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:27.982388 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24690eb7-2f40-4c8b-97d6-9709548cd6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:27.983491 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24690eb7-2f40-4c8b-97d6-9709548cd6bc None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:27.984011 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24690eb7-2f40-4c8b-97d6-9709548cd6bc None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:27.984549 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24690eb7-2f40-4c8b-97d6-9709548cd6bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:27.992583 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db0ac14-b148-4aa6-9e3f-2fe096536d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:27.993519 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0ac14-b148-4aa6-9e3f-2fe096536d6c None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:27.993803 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0ac14-b148-4aa6-9e3f-2fe096536d6c None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:27.994083 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0ac14-b148-4aa6-9e3f-2fe096536d6c None admin] PATH_INFO: `/v3/groups/1d3c5d1322fb40a68ec8f5172066c731` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:27.995354 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db0ac14-b148-4aa6-9e3f-2fe096536d6c None admin] RBAC: Authorizing `identity:get_group(group_id=1d3c5d1322fb40a68ec8f5172066c731)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:27.996895 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db0ac14-b148-4aa6-9e3f-2fe096536d6c None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:27.998873 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 208/434] 10.222.0.44 () {56 vars in 1180 bytes} [Wed May 25 11:52:27 2022] GET /identity/v3/groups/1d3c5d1322fb40a68ec8f5172066c731 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:28.006062 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db0ac14-b148-4aa6-9e3f-2fe096536d6c None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:28.064051 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24690eb7-2f40-4c8b-97d6-9709548cd6bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:28.065988 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24690eb7-2f40-4c8b-97d6-9709548cd6bc None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:28.078401 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:28.155177 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db0ac14-b148-4aa6-9e3f-2fe096536d6c None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:28.179742 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:28.192747 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d76859-a4ab-4af4-926c-59145c1e2b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:28.193462 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d76859-a4ab-4af4-926c-59145c1e2b09 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:28.193715 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d76859-a4ab-4af4-926c-59145c1e2b09 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:28.193992 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d76859-a4ab-4af4-926c-59145c1e2b09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:28.194836 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d76859-a4ab-4af4-926c-59145c1e2b09 None admin] RBAC: Adding query filter params (group.id=1d3c5d1322fb40a68ec8f5172066c731, role.id=1d75537a128747f180972029d0241cb4, scope.project.id=0499f6b6a46a4da2bb2ceedf8b6843b6) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:28.195172 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d76859-a4ab-4af4-926c-59145c1e2b09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:28.196788 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d76859-a4ab-4af4-926c-59145c1e2b09 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:28.198900 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 227/435] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 25 11:52:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 11:52:28.211319 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 209/436] 10.222.0.44 () {56 vars in 1376 bytes} [Wed May 25 11:52:28 2022] GET /identity/v3/role_assignments?group.id=1d3c5d1322fb40a68ec8f5172066c731&scope.project.id=0499f6b6a46a4da2bb2ceedf8b6843b6&role.id=1d75537a128747f180972029d0241cb4 => generated 611 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:28.212732 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24690eb7-2f40-4c8b-97d6-9709548cd6bc None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:28.333575 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24690eb7-2f40-4c8b-97d6-9709548cd6bc None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:28.345784 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:28.375998 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be70baf1-a5b7-4e6e-b4cb-a52c269de30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:28.377240 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70baf1-a5b7-4e6e-b4cb-a52c269de30b None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:28.377731 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70baf1-a5b7-4e6e-b4cb-a52c269de30b None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:28.378211 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70baf1-a5b7-4e6e-b4cb-a52c269de30b None admin] PATH_INFO: `/v3/projects/fbdd1a23ea8a4df7ad5aa9fb346fe0da` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:28.379758 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be70baf1-a5b7-4e6e-b4cb-a52c269de30b None admin] RBAC: Authorizing `identity:get_project(project_id=fbdd1a23ea8a4df7ad5aa9fb346fe0da)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:28.381622 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be70baf1-a5b7-4e6e-b4cb-a52c269de30b None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:28.383932 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 228/437] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 25 11:52:28 2022] GET /identity/v3/projects/fbdd1a23ea8a4df7ad5aa9fb346fe0da => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:28.390038 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d76859-a4ab-4af4-926c-59145c1e2b09 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:28.450111 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcccec13-dd96-4cf1-8cd1-7881ca5272ae None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:28.450428 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcccec13-dd96-4cf1-8cd1-7881ca5272ae None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:28.450674 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcccec13-dd96-4cf1-8cd1-7881ca5272ae None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:28.452351 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 229/438] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:52:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 11:52:28.458252 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a55a6-02b5-40d2-88e1-cc4e22e4eddf None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:28.458639 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a55a6-02b5-40d2-88e1-cc4e22e4eddf None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:28.458921 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a55a6-02b5-40d2-88e1-cc4e22e4eddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:28.478822 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-a93a55a6-02b5-40d2-88e1-cc4e22e4eddf None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:52:28.480538 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-a93a55a6-02b5-40d2-88e1-cc4e22e4eddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:52:28.518271 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d76859-a4ab-4af4-926c-59145c1e2b09 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:28.558887 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922033b4-5a56-460b-96e0-0d6650397112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:28.559938 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922033b4-5a56-460b-96e0-0d6650397112 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:28.560426 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922033b4-5a56-460b-96e0-0d6650397112 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:28.560718 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922033b4-5a56-460b-96e0-0d6650397112 None admin] PATH_INFO: `/v3/groups/1d3c5d1322fb40a68ec8f5172066c731` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:28.563124 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922033b4-5a56-460b-96e0-0d6650397112 None admin] RBAC: Authorizing `identity:get_group(group_id=1d3c5d1322fb40a68ec8f5172066c731)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:28.565142 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922033b4-5a56-460b-96e0-0d6650397112 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:28.567381 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 210/439] 10.222.0.44 () {56 vars in 1180 bytes} [Wed May 25 11:52:28 2022] GET /identity/v3/groups/1d3c5d1322fb40a68ec8f5172066c731 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:28.569032 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 230/440] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:52:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 11:52:28.574600 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922033b4-5a56-460b-96e0-0d6650397112 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:28.595101 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93a55a6-02b5-40d2-88e1-cc4e22e4eddf None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:28.647991 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:28.712035 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922033b4-5a56-460b-96e0-0d6650397112 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:28.720463 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93a55a6-02b5-40d2-88e1-cc4e22e4eddf None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:28.737279 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:28.759685 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be01e4-3221-41ea-9f3d-24213e6b9462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:28.760813 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be01e4-3221-41ea-9f3d-24213e6b9462 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:28.761359 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be01e4-3221-41ea-9f3d-24213e6b9462 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:28.761826 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be01e4-3221-41ea-9f3d-24213e6b9462 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:28.762690 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be01e4-3221-41ea-9f3d-24213e6b9462 None admin] RBAC: Adding query filter params (group.id=1d3c5d1322fb40a68ec8f5172066c731, role.id=0bb7b8a3ae8f4d03a7f575ca8904963c, scope.project.id=fbdd1a23ea8a4df7ad5aa9fb346fe0da) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:28.763003 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be01e4-3221-41ea-9f3d-24213e6b9462 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:28.764691 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be01e4-3221-41ea-9f3d-24213e6b9462 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:28.764899 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03506889-f00d-4228-bec4-732ed56e0c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:28.765711 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03506889-f00d-4228-bec4-732ed56e0c84 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:28.765995 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03506889-f00d-4228-bec4-732ed56e0c84 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:28.766273 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03506889-f00d-4228-bec4-732ed56e0c84 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:28.777445 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 211/441] 10.222.0.44 () {56 vars in 1376 bytes} [Wed May 25 11:52:28 2022] GET /identity/v3/role_assignments?group.id=1d3c5d1322fb40a68ec8f5172066c731&scope.project.id=fbdd1a23ea8a4df7ad5aa9fb346fe0da&role.id=0bb7b8a3ae8f4d03a7f575ca8904963c => generated 611 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:52:28.778339 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03506889-f00d-4228-bec4-732ed56e0c84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:52:28.786987 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-03506889-f00d-4228-bec4-732ed56e0c84 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 11:52:28.786987 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:28.786987 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:28.786987 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:28.786987 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:28.786987 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:28.786987 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:28.786987 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:28.786987 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:28.786987 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:28.786987 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:28.786987 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:28.786987 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:52:28.786987 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:52:28.786987 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:52:28.786987 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:52:28.788089 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:52:28.788089 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:52:28.788089 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:52:28.788089 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:52:28.788089 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:28.788089 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:28.788089 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:28.788089 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:28.788089 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:28.788089 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:28.788089 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:28.788089 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:52:28.788089 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:28.788089 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:28.788089 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:28.788089 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:28.788887 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:28.788887 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:28.788887 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:28.788887 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:28.788887 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:52:28.788887 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:52:28.788887 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:52:28.788887 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:52:28.788887 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:52:28.788887 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:52:28.788887 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 11:52:28.788887 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:52:28.788887 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 231/442] 10.222.0.44 () {56 vars in 1114 bytes} [Wed May 25 11:52:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:28.795292 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be01e4-3221-41ea-9f3d-24213e6b9462 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:28.853794 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638877c5-26a4-43cb-9ea0-2fc4905d63b1 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:28.854077 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638877c5-26a4-43cb-9ea0-2fc4905d63b1 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:28.854316 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638877c5-26a4-43cb-9ea0-2fc4905d63b1 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:28.856023 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 232/443] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:52:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 11:52:28.865566 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8532b8-2b86-4d94-aacd-79b1e2ce1cd5 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:28.865895 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8532b8-2b86-4d94-aacd-79b1e2ce1cd5 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:28.866195 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8532b8-2b86-4d94-aacd-79b1e2ce1cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:28.889943 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-3f8532b8-2b86-4d94-aacd-79b1e2ce1cd5 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:52:28.891182 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-3f8532b8-2b86-4d94-aacd-79b1e2ce1cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:52:28.929661 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be01e4-3221-41ea-9f3d-24213e6b9462 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:28.958401 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:28.978568 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef37646-dac8-492c-b714-86cb107d40c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:28.979299 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef37646-dac8-492c-b714-86cb107d40c8 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:28.979586 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef37646-dac8-492c-b714-86cb107d40c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:28.979948 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef37646-dac8-492c-b714-86cb107d40c8 None admin] PATH_INFO: `/v3/roles` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:28.981049 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef37646-dac8-492c-b714-86cb107d40c8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:28.981363 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef37646-dac8-492c-b714-86cb107d40c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:28.982782 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef37646-dac8-492c-b714-86cb107d40c8 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:28.988702 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 233/444] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:52:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 11:52:28.991788 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 212/445] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 25 11:52:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:28.997463 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8532b8-2b86-4d94-aacd-79b1e2ce1cd5 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:29.025146 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef37646-dac8-492c-b714-86cb107d40c8 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:29.112816 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:29.119955 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8532b8-2b86-4d94-aacd-79b1e2ce1cd5 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:29.150572 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef37646-dac8-492c-b714-86cb107d40c8 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:29.162192 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81005c92-cd73-46a0-b4ff-9dc0b3ff55df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:29.162855 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81005c92-cd73-46a0-b4ff-9dc0b3ff55df None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:29.163123 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81005c92-cd73-46a0-b4ff-9dc0b3ff55df None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:29.163395 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81005c92-cd73-46a0-b4ff-9dc0b3ff55df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:29.193409 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a26b6b-8e6c-49bc-879a-50224d552c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:29.194215 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a26b6b-8e6c-49bc-879a-50224d552c43 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:29.194500 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a26b6b-8e6c-49bc-879a-50224d552c43 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:29.194776 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a26b6b-8e6c-49bc-879a-50224d552c43 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:29.209363 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a26b6b-8e6c-49bc-879a-50224d552c43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:52:29.217733 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-e4a26b6b-8e6c-49bc-879a-50224d552c43 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 11:52:29.217733 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:29.217733 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:29.217733 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:29.217733 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:29.217733 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:29.217733 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:29.217733 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:29.217733 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:29.217733 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:29.217733 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:29.217733 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:29.217733 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:52:29.217733 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:52:29.217733 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:52:29.217733 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:52:29.218632 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:52:29.218632 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:52:29.218632 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:52:29.218632 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:52:29.218632 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:29.218632 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:29.218632 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:29.218632 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:29.218632 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:29.218632 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:29.218632 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:29.218632 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:52:29.218632 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:29.218632 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:29.218632 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:29.218632 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:29.219558 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:29.219558 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:29.219558 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:29.219558 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:29.219558 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:52:29.219558 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:52:29.219558 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:52:29.219558 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:52:29.219558 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:52:29.219558 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:52:29.219558 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 11:52:29.219558 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:52:29.219558 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 213/446] 10.222.0.44 () {56 vars in 1096 bytes} [Wed May 25 11:52:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 11:52:29.224703 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a26b6b-8e6c-49bc-879a-50224d552c43 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:29.245397 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81005c92-cd73-46a0-b4ff-9dc0b3ff55df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:29.246966 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81005c92-cd73-46a0-b4ff-9dc0b3ff55df None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:29.266521 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:29.321870 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a26b6b-8e6c-49bc-879a-50224d552c43 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:29.335872 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:29.343640 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 234/447] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 25 11:52:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 11:52:29.349194 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81005c92-cd73-46a0-b4ff-9dc0b3ff55df None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:29.355431 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11297dd9-5cd7-4856-90c1-af1f1ac1b022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:29.356112 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11297dd9-5cd7-4856-90c1-af1f1ac1b022 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:29.356394 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11297dd9-5cd7-4856-90c1-af1f1ac1b022 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:29.356659 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11297dd9-5cd7-4856-90c1-af1f1ac1b022 None admin] PATH_INFO: `/v3/roles` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:29.357401 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11297dd9-5cd7-4856-90c1-af1f1ac1b022 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:29.357702 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11297dd9-5cd7-4856-90c1-af1f1ac1b022 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:29.359066 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11297dd9-5cd7-4856-90c1-af1f1ac1b022 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:29.367603 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 214/448] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 25 11:52:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:52:29.372931 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11297dd9-5cd7-4856-90c1-af1f1ac1b022 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:29.443633 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81005c92-cd73-46a0-b4ff-9dc0b3ff55df None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:29.468102 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11297dd9-5cd7-4856-90c1-af1f1ac1b022 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:29.470286 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:29.477531 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d98f7-f386-445a-86a8-c4e0b5a3c378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:29.478381 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d98f7-f386-445a-86a8-c4e0b5a3c378 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:29.478664 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d98f7-f386-445a-86a8-c4e0b5a3c378 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:29.479025 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d98f7-f386-445a-86a8-c4e0b5a3c378 None admin] PATH_INFO: `/v3/projects/fbdd1a23ea8a4df7ad5aa9fb346fe0da` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:29.480763 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314d98f7-f386-445a-86a8-c4e0b5a3c378 None admin] RBAC: Authorizing `identity:get_project(project_id=fbdd1a23ea8a4df7ad5aa9fb346fe0da)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:29.482201 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314d98f7-f386-445a-86a8-c4e0b5a3c378 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:29.483909 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 235/449] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 25 11:52:29 2022] GET /identity/v3/projects/fbdd1a23ea8a4df7ad5aa9fb346fe0da => generated 302 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:52:29.489382 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d98f7-f386-445a-86a8-c4e0b5a3c378 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:29.501664 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64c8a9-e192-439c-a392-59c27c584531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:29.502312 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64c8a9-e192-439c-a392-59c27c584531 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:29.502600 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64c8a9-e192-439c-a392-59c27c584531 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:29.502881 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64c8a9-e192-439c-a392-59c27c584531 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:29.549034 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:29.573187 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea64c8a9-e192-439c-a392-59c27c584531 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:29.574656 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea64c8a9-e192-439c-a392-59c27c584531 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:29.589739 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d98f7-f386-445a-86a8-c4e0b5a3c378 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:29.623585 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b75aacc-6639-4ffc-97e4-66ad688281ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:29.624418 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75aacc-6639-4ffc-97e4-66ad688281ff None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:29.624704 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75aacc-6639-4ffc-97e4-66ad688281ff None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:29.624979 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b75aacc-6639-4ffc-97e4-66ad688281ff None admin] PATH_INFO: `/v3/groups/1d3c5d1322fb40a68ec8f5172066c731` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:29.626176 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b75aacc-6639-4ffc-97e4-66ad688281ff None admin] RBAC: Authorizing `identity:get_group(group_id=1d3c5d1322fb40a68ec8f5172066c731)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:29.627593 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b75aacc-6639-4ffc-97e4-66ad688281ff None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:29.629230 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 236/450] 10.222.0.44 () {56 vars in 1180 bytes} [Wed May 25 11:52:29 2022] GET /identity/v3/groups/1d3c5d1322fb40a68ec8f5172066c731 => generated 226 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:29.636254 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b75aacc-6639-4ffc-97e4-66ad688281ff None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:29.670850 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 215/451] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 25 11:52:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 11:52:29.676248 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64c8a9-e192-439c-a392-59c27c584531 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:29.678810 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:29.731939 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b75aacc-6639-4ffc-97e4-66ad688281ff None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:29.759936 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:29.765738 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78466b3f-fc6f-4019-9df6-b144c04e1a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:29.766386 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78466b3f-fc6f-4019-9df6-b144c04e1a61 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:29.766664 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78466b3f-fc6f-4019-9df6-b144c04e1a61 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:29.766938 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78466b3f-fc6f-4019-9df6-b144c04e1a61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:29.767747 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78466b3f-fc6f-4019-9df6-b144c04e1a61 None admin] RBAC: Adding query filter params (group.id=1d3c5d1322fb40a68ec8f5172066c731, role.id=1d75537a128747f180972029d0241cb4, scope.project.id=fbdd1a23ea8a4df7ad5aa9fb346fe0da) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:29.768081 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78466b3f-fc6f-4019-9df6-b144c04e1a61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:29.769490 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78466b3f-fc6f-4019-9df6-b144c04e1a61 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:29.774984 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64c8a9-e192-439c-a392-59c27c584531 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:29.775534 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 237/452] 10.222.0.44 () {56 vars in 1376 bytes} [Wed May 25 11:52:29 2022] GET /identity/v3/role_assignments?group.id=1d3c5d1322fb40a68ec8f5172066c731&scope.project.id=fbdd1a23ea8a4df7ad5aa9fb346fe0da&role.id=1d75537a128747f180972029d0241cb4 => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:52:29.811653 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01307c0-2903-46a5-be54-f91cef19b8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:29.812570 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01307c0-2903-46a5-be54-f91cef19b8e9 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:29.812856 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01307c0-2903-46a5-be54-f91cef19b8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:29.813134 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01307c0-2903-46a5-be54-f91cef19b8e9 None admin] PATH_INFO: `/v3/projects/7103ef35356d4cd6a0f435bed6b1df47` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:29.814387 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01307c0-2903-46a5-be54-f91cef19b8e9 None admin] RBAC: Authorizing `identity:get_project(project_id=7103ef35356d4cd6a0f435bed6b1df47)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:29.815916 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01307c0-2903-46a5-be54-f91cef19b8e9 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:29.817675 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 216/453] 10.222.0.44 () {56 vars in 1186 bytes} [Wed May 25 11:52:29 2022] GET /identity/v3/projects/7103ef35356d4cd6a0f435bed6b1df47 => generated 344 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:29.823880 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78466b3f-fc6f-4019-9df6-b144c04e1a61 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:29.929730 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78466b3f-fc6f-4019-9df6-b144c04e1a61 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:29.964090 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c30d956-194b-4eb6-ada5-34cff5f741d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:29.964951 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c30d956-194b-4eb6-ada5-34cff5f741d7 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:29.965218 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c30d956-194b-4eb6-ada5-34cff5f741d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:29.965493 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c30d956-194b-4eb6-ada5-34cff5f741d7 None admin] PATH_INFO: `/v3/groups/173c6576ebe34a41a3066ad652b2f395` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:29.966662 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c30d956-194b-4eb6-ada5-34cff5f741d7 None admin] RBAC: Authorizing `identity:get_group(group_id=173c6576ebe34a41a3066ad652b2f395)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:29.968137 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c30d956-194b-4eb6-ada5-34cff5f741d7 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:29.969730 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 238/454] 10.222.0.44 () {56 vars in 1180 bytes} [Wed May 25 11:52:29 2022] GET /identity/v3/groups/173c6576ebe34a41a3066ad652b2f395 => generated 229 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:29.977721 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01307c0-2903-46a5-be54-f91cef19b8e9 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:30.047687 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:30.078972 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01307c0-2903-46a5-be54-f91cef19b8e9 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:30.112571 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657b8b0-113e-489f-8e1d-0a500abbf4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:30.113225 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657b8b0-113e-489f-8e1d-0a500abbf4bd None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:30.113510 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657b8b0-113e-489f-8e1d-0a500abbf4bd None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:30.113787 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657b8b0-113e-489f-8e1d-0a500abbf4bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:30.114607 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d657b8b0-113e-489f-8e1d-0a500abbf4bd None admin] RBAC: Adding query filter params (group.id=173c6576ebe34a41a3066ad652b2f395, role.id=2fe5c1214bcc4c1bafa5a4545161518d, scope.project.id=7103ef35356d4cd6a0f435bed6b1df47) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:30.114921 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d657b8b0-113e-489f-8e1d-0a500abbf4bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:30.116397 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d657b8b0-113e-489f-8e1d-0a500abbf4bd None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:30.122790 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 217/455] 10.222.0.44 () {56 vars in 1376 bytes} [Wed May 25 11:52:29 2022] GET /identity/v3/role_assignments?group.id=173c6576ebe34a41a3066ad652b2f395&scope.project.id=7103ef35356d4cd6a0f435bed6b1df47&role.id=2fe5c1214bcc4c1bafa5a4545161518d => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:32.665580 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547a71a-ec16-4598-b291-ec23d393baa9 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:32.666102 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547a71a-ec16-4598-b291-ec23d393baa9 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:32.666179 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547a71a-ec16-4598-b291-ec23d393baa9 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:32.668300 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 239/456] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:52:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:52:32.673933 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5b023-2d69-44c1-9efe-6b0984fe0df5 None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:32.674791 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5b023-2d69-44c1-9efe-6b0984fe0df5 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:32.675289 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5b023-2d69-44c1-9efe-6b0984fe0df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:32.694241 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-84e5b023-2d69-44c1-9efe-6b0984fe0df5 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:52:32.695750 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-84e5b023-2d69-44c1-9efe-6b0984fe0df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:52:32.766629 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 218/457] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:52:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 11:52:32.794050 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547a71a-ec16-4598-b291-ec23d393baa9 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:32.829636 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca572b8b-be08-42f3-9959-44e4994c5e1a None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:32.829939 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca572b8b-be08-42f3-9959-44e4994c5e1a None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:32.830206 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca572b8b-be08-42f3-9959-44e4994c5e1a None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:32.831562 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 219/458] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:52:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 11:52:32.836762 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fb1f9-8694-496b-890e-757e9d79226d None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:32.837234 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fb1f9-8694-496b-890e-757e9d79226d None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:32.837509 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fb1f9-8694-496b-890e-757e9d79226d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:32.854832 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-cd9fb1f9-8694-496b-890e-757e9d79226d None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:52:32.856394 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-cd9fb1f9-8694-496b-890e-757e9d79226d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:52:32.863521 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:32.915357 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547a71a-ec16-4598-b291-ec23d393baa9 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:32.938354 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:32.955817 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 220/459] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:52:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 11:52:32.958763 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30420627-cfc9-4212-a787-58422419cf2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:32.959560 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30420627-cfc9-4212-a787-58422419cf2d None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:32.959942 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30420627-cfc9-4212-a787-58422419cf2d None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:32.960217 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30420627-cfc9-4212-a787-58422419cf2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:32.971870 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30420627-cfc9-4212-a787-58422419cf2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:32.973336 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30420627-cfc9-4212-a787-58422419cf2d None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:32.975605 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c43ae6-8caf-416e-a648-a8f98c584979 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:32.976163 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c43ae6-8caf-416e-a648-a8f98c584979 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:32.976592 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c43ae6-8caf-416e-a648-a8f98c584979 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:32.978239 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 221/460] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:52:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 11:52:32.982541 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c43ae6-8caf-416e-a648-a8f98c584979 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:32.993967 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-30420627-cfc9-4212-a787-58422419cf2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:52:32.993967 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:32.993967 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:32.993967 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:32.993967 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:32.993967 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:32.993967 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:32.993967 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:32.993967 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:32.993967 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:32.993967 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:32.993967 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:32.993967 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 11:52:32.993967 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 11:52:32.993967 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 11:52:32.994882 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 11:52:32.994882 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:32.994882 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:32.994882 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:32.994882 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:32.994882 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:32.994882 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:32.994882 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:32.994882 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:52:32.994882 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:32.994882 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:32.994882 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:32.994882 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:32.994882 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:32.994882 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:32.994882 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:32.994882 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:32.996516 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 11:52:32.996516 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 11:52:32.996516 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:52:32.996516 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:52:32.996516 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 240/461] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:52:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:32.996799 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af50d3-2e38-47e1-aec3-45b97c09d589 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:32.997017 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af50d3-2e38-47e1-aec3-45b97c09d589 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:32.997290 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af50d3-2e38-47e1-aec3-45b97c09d589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:33.013727 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-03af50d3-2e38-47e1-aec3-45b97c09d589 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:52:33.014910 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-03af50d3-2e38-47e1-aec3-45b97c09d589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:52:33.088934 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 241/462] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:52:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 11:52:33.092980 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af50d3-2e38-47e1-aec3-45b97c09d589 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:33.101445 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c43ae6-8caf-416e-a648-a8f98c584979 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:33.137076 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe8442-e4d4-42e5-8562-2efdad6e3773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:33.137871 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe8442-e4d4-42e5-8562-2efdad6e3773 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:33.138146 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe8442-e4d4-42e5-8562-2efdad6e3773 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:33.138416 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe8442-e4d4-42e5-8562-2efdad6e3773 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:33.145245 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:33.154398 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abe8442-e4d4-42e5-8562-2efdad6e3773 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:33.156413 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abe8442-e4d4-42e5-8562-2efdad6e3773 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:33.182442 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-8abe8442-e4d4-42e5-8562-2efdad6e3773 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:52:33.182442 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:33.182442 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:33.182442 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:33.182442 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:33.182442 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:33.182442 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:33.182442 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:33.182442 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:33.182442 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:33.182442 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:33.182442 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:33.182442 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 11:52:33.182442 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 11:52:33.182442 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 11:52:33.183377 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 11:52:33.183377 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:33.183377 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:33.183377 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:33.183377 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:33.183377 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:33.183377 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:33.183377 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:33.183377 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:52:33.183377 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:33.183377 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:33.183377 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:33.183377 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:33.183377 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:33.183377 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:33.183377 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:33.183377 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:33.188867 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 11:52:33.188867 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 11:52:33.188867 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:52:33.188867 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:52:33.188867 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 222/463] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:52:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:33.188867 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe8442-e4d4-42e5-8562-2efdad6e3773 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:33.217867 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af50d3-2e38-47e1-aec3-45b97c09d589 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:33.237660 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:33.253293 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a96ff-fe47-4ab7-b73a-adc1f125ebac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:33.253950 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a96ff-fe47-4ab7-b73a-adc1f125ebac None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:33.254321 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a96ff-fe47-4ab7-b73a-adc1f125ebac None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:33.254504 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a96ff-fe47-4ab7-b73a-adc1f125ebac None admin] PATH_INFO: `/v3/domains` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:33.255223 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a96ff-fe47-4ab7-b73a-adc1f125ebac None admin] RBAC: Adding query filter params (name=Default) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:33.255530 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a96ff-fe47-4ab7-b73a-adc1f125ebac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:33.256923 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a96ff-fe47-4ab7-b73a-adc1f125ebac None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:33.268072 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 242/464] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 25 11:52:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:33.268845 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a96ff-fe47-4ab7-b73a-adc1f125ebac None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:33.291078 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe8442-e4d4-42e5-8562-2efdad6e3773 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:33.325774 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c766a22c-4a25-44bc-9a3f-7df28760bf48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:33.326560 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766a22c-4a25-44bc-9a3f-7df28760bf48 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:33.326845 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766a22c-4a25-44bc-9a3f-7df28760bf48 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:33.327122 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c766a22c-4a25-44bc-9a3f-7df28760bf48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:33.336775 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c766a22c-4a25-44bc-9a3f-7df28760bf48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:33.338833 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c766a22c-4a25-44bc-9a3f-7df28760bf48 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:33.355895 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-c766a22c-4a25-44bc-9a3f-7df28760bf48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:52:33.355895 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:33.355895 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:33.355895 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:33.355895 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:33.355895 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:33.355895 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:33.355895 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:33.355895 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:33.355895 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:33.355895 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:33.355895 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:33.355895 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 11:52:33.355895 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 11:52:33.355895 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 11:52:33.356875 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 11:52:33.356875 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:33.356875 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:33.356875 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:33.356875 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:33.356875 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:33.356875 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:33.356875 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:33.356875 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:52:33.356875 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:33.356875 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:33.356875 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:33.356875 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:33.356875 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:33.356875 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:33.356875 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:33.356875 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:33.357892 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 11:52:33.357892 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 11:52:33.357892 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:52:33.357892 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:52:33.357892 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 223/465] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:52:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:33.358636 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986edb0-2026-4af9-b4fa-6db68fb2580f None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:33.358929 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986edb0-2026-4af9-b4fa-6db68fb2580f None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:33.359208 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986edb0-2026-4af9-b4fa-6db68fb2580f None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:33.360472 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 224/466] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:52:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:52:33.361151 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986edb0-2026-4af9-b4fa-6db68fb2580f None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:33.370524 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a96ff-fe47-4ab7-b73a-adc1f125ebac None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:33.377412 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:33.404711 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5047d8-15e8-46aa-b52a-797062955ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:33.405369 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5047d8-15e8-46aa-b52a-797062955ea0 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:33.405656 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5047d8-15e8-46aa-b52a-797062955ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:33.405932 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5047d8-15e8-46aa-b52a-797062955ea0 None admin] PATH_INFO: `/v3/domains` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:33.406653 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5047d8-15e8-46aa-b52a-797062955ea0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:33.406961 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5047d8-15e8-46aa-b52a-797062955ea0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:33.408373 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5047d8-15e8-46aa-b52a-797062955ea0 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:33.420333 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 243/467] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 25 11:52:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:33.421113 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5047d8-15e8-46aa-b52a-797062955ea0 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:33.460665 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:33.464737 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986edb0-2026-4af9-b4fa-6db68fb2580f None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:33.499134 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94db0eb-0c32-490e-b1c0-be47885a29a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:33.499824 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94db0eb-0c32-490e-b1c0-be47885a29a7 None admin] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:33.500115 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94db0eb-0c32-490e-b1c0-be47885a29a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:33.500399 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94db0eb-0c32-490e-b1c0-be47885a29a7 None admin] PATH_INFO: `/v3/users` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:33.501097 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94db0eb-0c32-490e-b1c0-be47885a29a7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:33.502535 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94db0eb-0c32-490e-b1c0-be47885a29a7 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:33.519368 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5047d8-15e8-46aa-b52a-797062955ea0 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:33.521201 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 225/468] 10.222.0.44 () {60 vars in 1132 bytes} [Wed May 25 11:52:33 2022] POST /identity/v3/users => generated 246 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 11:52:33.522482 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ed97f-2ff9-47ac-ad36-60594386d1ee None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:33.522770 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ed97f-2ff9-47ac-ad36-60594386d1ee None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:33.523047 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ed97f-2ff9-47ac-ad36-60594386d1ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:33.540431 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-c26ed97f-2ff9-47ac-ad36-60594386d1ee None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:52:33.542207 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-c26ed97f-2ff9-47ac-ad36-60594386d1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:52:33.572143 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67afccc-b89e-4736-973a-9f7c6d5a1b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:33.573918 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67afccc-b89e-4736-973a-9f7c6d5a1b51 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:33.573918 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67afccc-b89e-4736-973a-9f7c6d5a1b51 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:33.573918 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67afccc-b89e-4736-973a-9f7c6d5a1b51 None admin] PATH_INFO: `/v3/domains` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:33.574844 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67afccc-b89e-4736-973a-9f7c6d5a1b51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:33.575012 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67afccc-b89e-4736-973a-9f7c6d5a1b51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:33.577137 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67afccc-b89e-4736-973a-9f7c6d5a1b51 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:33.591025 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 244/469] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 25 11:52:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:33.591918 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67afccc-b89e-4736-973a-9f7c6d5a1b51 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:33.625058 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:33.626451 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 226/470] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:52:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 11:52:33.627308 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ed97f-2ff9-47ac-ad36-60594386d1ee None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:33.722426 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67afccc-b89e-4736-973a-9f7c6d5a1b51 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:33.737563 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:33.754268 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ed97f-2ff9-47ac-ad36-60594386d1ee None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:33.772047 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf964c-3712-41c6-89d0-ac727980716c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:33.772723 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf964c-3712-41c6-89d0-ac727980716c None admin] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:33.773012 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf964c-3712-41c6-89d0-ac727980716c None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:33.773295 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf964c-3712-41c6-89d0-ac727980716c None admin] PATH_INFO: `/v3/users` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:33.774001 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baf964c-3712-41c6-89d0-ac727980716c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:33.775447 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baf964c-3712-41c6-89d0-ac727980716c None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:33.795461 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9a3c7d-dbac-4019-bc90-52dd00db3ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:33.796179 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a3c7d-dbac-4019-bc90-52dd00db3ba2 None admin] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:33.796640 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 245/471] 10.222.0.44 () {60 vars in 1132 bytes} [Wed May 25 11:52:33 2022] POST /identity/v3/users => generated 248 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 11:52:33.796760 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a3c7d-dbac-4019-bc90-52dd00db3ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:33.796835 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a3c7d-dbac-4019-bc90-52dd00db3ba2 None admin] PATH_INFO: `/v3/users` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:33.797274 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf964c-3712-41c6-89d0-ac727980716c None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:33.797649 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9a3c7d-dbac-4019-bc90-52dd00db3ba2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:33.799115 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9a3c7d-dbac-4019-bc90-52dd00db3ba2 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:33.839693 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 227/472] 10.222.0.44 () {60 vars in 1132 bytes} [Wed May 25 11:52:33 2022] POST /identity/v3/users => generated 248 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 11:52:33.925919 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:33.949506 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf964c-3712-41c6-89d0-ac727980716c None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:33.992390 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb6ea8-5511-46ef-ac88-6da8bbf98c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:33.993463 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb6ea8-5511-46ef-ac88-6da8bbf98c2b None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:33.993995 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb6ea8-5511-46ef-ac88-6da8bbf98c2b None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:33.994469 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb6ea8-5511-46ef-ac88-6da8bbf98c2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:34.007696 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdb6ea8-5511-46ef-ac88-6da8bbf98c2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:34.009232 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdb6ea8-5511-46ef-ac88-6da8bbf98c2b None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:34.029995 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-5bdb6ea8-5511-46ef-ac88-6da8bbf98c2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:52:34.029995 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:34.029995 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:34.029995 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:34.029995 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:34.029995 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:34.029995 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:34.029995 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:34.029995 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:34.029995 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:34.029995 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:34.029995 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:34.029995 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 11:52:34.029995 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 11:52:34.029995 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 11:52:34.030910 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 11:52:34.030910 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:34.030910 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:34.030910 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:34.030910 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:34.030910 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:34.030910 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:34.030910 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:34.030910 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:52:34.030910 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:34.030910 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:34.030910 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:34.030910 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:34.030910 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:34.030910 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:34.030910 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:34.030910 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:34.031772 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 11:52:34.031772 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 11:52:34.031772 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:52:34.031772 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:52:34.031772 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 246/473] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:52:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:34.037470 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9a3c7d-dbac-4019-bc90-52dd00db3ba2 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:34.153285 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9a3c7d-dbac-4019-bc90-52dd00db3ba2 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:34.193950 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989d2691-a667-45be-b5d1-38def39042a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:34.194691 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d2691-a667-45be-b5d1-38def39042a9 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:34.194979 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d2691-a667-45be-b5d1-38def39042a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:34.195258 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d2691-a667-45be-b5d1-38def39042a9 None admin] PATH_INFO: `/v3/domains` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:34.196367 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989d2691-a667-45be-b5d1-38def39042a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:34.196684 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989d2691-a667-45be-b5d1-38def39042a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:34.198620 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989d2691-a667-45be-b5d1-38def39042a9 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:34.218010 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 228/474] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 25 11:52:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:34.223259 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb6ea8-5511-46ef-ac88-6da8bbf98c2b None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:34.333429 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb6ea8-5511-46ef-ac88-6da8bbf98c2b None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:34.369782 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ce578-cfec-49c3-8d1d-cfa5617b5142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:34.370824 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ce578-cfec-49c3-8d1d-cfa5617b5142 None admin] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:34.371322 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ce578-cfec-49c3-8d1d-cfa5617b5142 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:34.371822 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ce578-cfec-49c3-8d1d-cfa5617b5142 None admin] PATH_INFO: `/v3/users` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:34.372769 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361ce578-cfec-49c3-8d1d-cfa5617b5142 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:34.374415 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361ce578-cfec-49c3-8d1d-cfa5617b5142 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:34.381582 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:34.399819 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 247/475] 10.222.0.44 () {60 vars in 1132 bytes} [Wed May 25 11:52:34 2022] POST /identity/v3/users => generated 249 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 11:52:35.920465 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e527d-77b4-41d2-b2e7-70019f6c0243 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:35.920465 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e527d-77b4-41d2-b2e7-70019f6c0243 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:35.920465 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e527d-77b4-41d2-b2e7-70019f6c0243 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:35.921134 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 229/476] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:52:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:52:35.926623 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5bbfd-3134-4a34-b4a5-6fcf14d81445 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:35.927037 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5bbfd-3134-4a34-b4a5-6fcf14d81445 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:35.927346 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5bbfd-3134-4a34-b4a5-6fcf14d81445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:35.949427 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-5ab5bbfd-3134-4a34-b4a5-6fcf14d81445 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:52:35.950630 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-5ab5bbfd-3134-4a34-b4a5-6fcf14d81445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:52:36.018909 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 248/477] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:52:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 11:52:36.044929 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e527d-77b4-41d2-b2e7-70019f6c0243 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:36.048369 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:36.167023 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e527d-77b4-41d2-b2e7-70019f6c0243 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:36.203899 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7591d2-5eda-4f70-9c58-5d2d17891395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:36.204791 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7591d2-5eda-4f70-9c58-5d2d17891395 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:36.205089 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7591d2-5eda-4f70-9c58-5d2d17891395 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:36.205373 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7591d2-5eda-4f70-9c58-5d2d17891395 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:36.216703 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7591d2-5eda-4f70-9c58-5d2d17891395 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:52:36.224485 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-2c7591d2-5eda-4f70-9c58-5d2d17891395 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 11:52:36.224485 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:36.224485 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:36.224485 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:36.224485 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:36.224485 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:36.224485 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:36.224485 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:36.224485 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:36.224485 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:36.224485 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:36.224485 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:36.224485 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:52:36.224485 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:52:36.224485 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:52:36.224485 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:52:36.225382 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:52:36.225382 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:52:36.225382 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:52:36.225382 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:52:36.225382 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:36.225382 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:36.225382 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:36.225382 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:36.225382 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:36.225382 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:36.225382 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:36.225382 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:52:36.225382 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:36.225382 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:36.225382 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:36.225382 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:36.226179 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:36.226179 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:36.226179 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:36.226179 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:36.226179 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:52:36.226179 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:52:36.226179 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:52:36.226179 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:52:36.226179 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:52:36.226179 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:52:36.226179 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 11:52:36.226179 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:52:36.226179 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 230/478] 10.222.0.44 () {56 vars in 1102 bytes} [Wed May 25 11:52:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:36.231722 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5bbfd-3134-4a34-b4a5-6fcf14d81445 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:36.235195 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e160394-f8ad-4a02-8097-d376b172ba5b None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:36.235576 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e160394-f8ad-4a02-8097-d376b172ba5b None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:36.235893 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e160394-f8ad-4a02-8097-d376b172ba5b None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:36.237509 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 231/479] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:52:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 11:52:36.242523 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43091034-726e-4e57-b660-7077dd27276a None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:36.242818 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43091034-726e-4e57-b660-7077dd27276a None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:36.243105 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43091034-726e-4e57-b660-7077dd27276a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:36.264464 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-43091034-726e-4e57-b660-7077dd27276a None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:52:36.266344 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-43091034-726e-4e57-b660-7077dd27276a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:52:36.330039 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:36.348156 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 232/480] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:52:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 11:52:36.350535 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5bbfd-3134-4a34-b4a5-6fcf14d81445 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:36.352219 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab1aed-0694-4529-b6a8-df350c51e747 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:36.352707 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab1aed-0694-4529-b6a8-df350c51e747 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:36.353229 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab1aed-0694-4529-b6a8-df350c51e747 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:36.355485 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 233/481] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:52:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 11:52:36.360280 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559da46-7fc4-420c-9c98-54215e269eec None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:36.360811 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559da46-7fc4-420c-9c98-54215e269eec None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:36.361367 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559da46-7fc4-420c-9c98-54215e269eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:36.374128 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:36.380299 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-1559da46-7fc4-420c-9c98-54215e269eec None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:52:36.381257 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-1559da46-7fc4-420c-9c98-54215e269eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:52:36.393158 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce5082-92b4-4db8-b394-73ed64fd9d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:36.394106 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce5082-92b4-4db8-b394-73ed64fd9d05 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:36.394397 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce5082-92b4-4db8-b394-73ed64fd9d05 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:36.394677 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce5082-92b4-4db8-b394-73ed64fd9d05 None admin] PATH_INFO: `/v3/roles` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:36.396172 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce5082-92b4-4db8-b394-73ed64fd9d05 None admin] RBAC: Adding query filter params (name=service) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:36.396757 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce5082-92b4-4db8-b394-73ed64fd9d05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:36.398675 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce5082-92b4-4db8-b394-73ed64fd9d05 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:36.408844 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 249/482] 10.222.0.44 () {56 vars in 1103 bytes} [Wed May 25 11:52:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:36.409664 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce5082-92b4-4db8-b394-73ed64fd9d05 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:36.456068 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 234/483] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:52:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 11:52:36.456511 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1559da46-7fc4-420c-9c98-54215e269eec None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:36.528363 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce5082-92b4-4db8-b394-73ed64fd9d05 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:36.565606 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732f6d1-a17f-4dee-b700-d2b8e641f6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:36.566431 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732f6d1-a17f-4dee-b700-d2b8e641f6d7 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:36.566717 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732f6d1-a17f-4dee-b700-d2b8e641f6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:36.566993 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732f6d1-a17f-4dee-b700-d2b8e641f6d7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:36.570647 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1559da46-7fc4-420c-9c98-54215e269eec None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:36.579006 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7732f6d1-a17f-4dee-b700-d2b8e641f6d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:52:36.586938 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-7732f6d1-a17f-4dee-b700-d2b8e641f6d7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 11:52:36.586938 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:36.586938 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:36.586938 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:36.586938 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:36.586938 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:36.586938 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:36.586938 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:36.586938 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:36.586938 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:36.586938 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:36.586938 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:36.586938 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:52:36.586938 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:52:36.586938 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:52:36.586938 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:52:36.588002 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:52:36.588002 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:52:36.588002 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:52:36.588002 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:52:36.588002 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:36.588002 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:36.588002 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:36.588002 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:36.588002 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:36.588002 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:36.588002 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:36.588002 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:52:36.588002 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:36.588002 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:36.588002 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:36.588002 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:36.588810 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:36.588810 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:36.588810 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:36.588810 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:36.588810 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:52:36.588810 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:52:36.588810 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:52:36.588810 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:52:36.588810 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:52:36.588810 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:52:36.588810 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 11:52:36.588810 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:52:36.588810 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 250/484] 10.222.0.44 () {56 vars in 1102 bytes} [Wed May 25 11:52:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:36.593026 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732f6d1-a17f-4dee-b700-d2b8e641f6d7 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:36.599349 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:36.612566 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d6119-8c9a-485d-8e35-5d8f42eff1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:36.613367 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d6119-8c9a-485d-8e35-5d8f42eff1df None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:36.613656 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d6119-8c9a-485d-8e35-5d8f42eff1df None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:36.613939 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d6119-8c9a-485d-8e35-5d8f42eff1df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:36.625617 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7d6119-8c9a-485d-8e35-5d8f42eff1df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:36.627092 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7d6119-8c9a-485d-8e35-5d8f42eff1df None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:36.645363 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:36.646126 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-ce7d6119-8c9a-485d-8e35-5d8f42eff1df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:52:36.646126 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:36.646126 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:36.646126 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:36.646126 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:36.646126 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:36.646126 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:36.646126 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:36.646126 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:36.646126 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:36.646126 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:36.646126 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:36.646126 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 11:52:36.646126 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 11:52:36.646126 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 11:52:36.647302 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 11:52:36.647302 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:36.647302 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:36.647302 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:36.647302 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:36.647302 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:36.647302 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:36.647302 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:36.647302 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:52:36.647302 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:36.647302 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:36.647302 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:36.647302 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:36.647302 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:36.647302 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:36.647302 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:36.647302 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:36.649004 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 11:52:36.649004 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 11:52:36.649004 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:52:36.649004 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:52:36.649004 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 235/485] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:52:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:36.649004 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d6119-8c9a-485d-8e35-5d8f42eff1df None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:36.712713 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732f6d1-a17f-4dee-b700-d2b8e641f6d7 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:36.748284 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e207b1b-00d7-4931-ad4c-158ed555c403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:36.749076 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e207b1b-00d7-4931-ad4c-158ed555c403 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:36.749357 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e207b1b-00d7-4931-ad4c-158ed555c403 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:36.749635 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e207b1b-00d7-4931-ad4c-158ed555c403 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:36.760316 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d6119-8c9a-485d-8e35-5d8f42eff1df None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:36.760449 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e207b1b-00d7-4931-ad4c-158ed555c403 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:52:36.768101 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-1e207b1b-00d7-4931-ad4c-158ed555c403 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 11:52:36.768101 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:36.768101 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:36.768101 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:36.768101 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:36.768101 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:36.768101 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:36.768101 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:36.768101 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:36.768101 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:36.768101 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:36.768101 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:36.768101 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:52:36.768101 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:52:36.768101 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:52:36.768101 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:52:36.769022 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:52:36.769022 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:52:36.769022 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:52:36.769022 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:52:36.769022 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:36.769022 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:36.769022 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:36.769022 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:36.769022 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:36.769022 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:36.769022 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:36.769022 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:52:36.769022 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:36.769022 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:36.769022 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:36.769022 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:36.769840 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:36.769840 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:36.769840 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:36.769840 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:36.769840 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:52:36.769840 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:52:36.769840 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:52:36.769840 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:52:36.769840 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:52:36.769840 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:52:36.769840 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 11:52:36.769840 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:52:36.769840 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 251/486] 10.222.0.44 () {56 vars in 1102 bytes} [Wed May 25 11:52:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:36.770493 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e207b1b-00d7-4931-ad4c-158ed555c403 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:36.795274 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59916665-4697-4336-917e-d427c948a497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:36.795967 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59916665-4697-4336-917e-d427c948a497 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:36.796249 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59916665-4697-4336-917e-d427c948a497 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:36.796520 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59916665-4697-4336-917e-d427c948a497 None admin] PATH_INFO: `/v3/roles` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:36.797256 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59916665-4697-4336-917e-d427c948a497 None admin] RBAC: Adding query filter params (name=service) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:36.797556 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59916665-4697-4336-917e-d427c948a497 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:36.798922 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59916665-4697-4336-917e-d427c948a497 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:36.806490 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 236/487] 10.222.0.44 () {56 vars in 1103 bytes} [Wed May 25 11:52:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:36.807703 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3168e4-2344-4e67-8ac2-af55723b26f8 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:36.808020 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3168e4-2344-4e67-8ac2-af55723b26f8 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:36.808297 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3168e4-2344-4e67-8ac2-af55723b26f8 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:36.809498 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 237/488] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:52:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:52:36.810176 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3168e4-2344-4e67-8ac2-af55723b26f8 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:36.845573 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:36.882021 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e207b1b-00d7-4931-ad4c-158ed555c403 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:36.883821 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:36.920368 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3168e4-2344-4e67-8ac2-af55723b26f8 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:36.920797 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f822f45b-fd2b-4212-b3e7-af9050584717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:36.921457 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f822f45b-fd2b-4212-b3e7-af9050584717 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:36.921744 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f822f45b-fd2b-4212-b3e7-af9050584717 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:36.922017 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f822f45b-fd2b-4212-b3e7-af9050584717 None admin] PATH_INFO: `/v3/domains` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:36.922731 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f822f45b-fd2b-4212-b3e7-af9050584717 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:36.923035 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f822f45b-fd2b-4212-b3e7-af9050584717 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:36.924437 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f822f45b-fd2b-4212-b3e7-af9050584717 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:36.936052 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 252/489] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 25 11:52:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:36.936847 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f822f45b-fd2b-4212-b3e7-af9050584717 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:36.954449 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867aa286-f4bd-40d7-a1eb-06fcf1270e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:36.955120 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867aa286-f4bd-40d7-a1eb-06fcf1270e58 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:36.955414 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867aa286-f4bd-40d7-a1eb-06fcf1270e58 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:36.955696 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867aa286-f4bd-40d7-a1eb-06fcf1270e58 None admin] PATH_INFO: `/v3/roles` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:36.956473 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867aa286-f4bd-40d7-a1eb-06fcf1270e58 None admin] RBAC: Adding query filter params (name=service) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:36.956788 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867aa286-f4bd-40d7-a1eb-06fcf1270e58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:36.958178 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867aa286-f4bd-40d7-a1eb-06fcf1270e58 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:36.966473 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 238/490] 10.222.0.44 () {56 vars in 1103 bytes} [Wed May 25 11:52:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:36.967561 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9650d-597c-4996-bac2-1ee0758c8e35 None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:36.967886 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9650d-597c-4996-bac2-1ee0758c8e35 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:36.968175 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9650d-597c-4996-bac2-1ee0758c8e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:36.984356 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-b0a9650d-597c-4996-bac2-1ee0758c8e35 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:52:36.985577 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-b0a9650d-597c-4996-bac2-1ee0758c8e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:52:37.035697 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f822f45b-fd2b-4212-b3e7-af9050584717 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:37.051284 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 239/491] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:52:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 11:52:37.052140 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a9650d-597c-4996-bac2-1ee0758c8e35 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:37.069774 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bafa24-cded-41ed-980c-c6cd3cc01439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:37.070558 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bafa24-cded-41ed-980c-c6cd3cc01439 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:37.070843 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bafa24-cded-41ed-980c-c6cd3cc01439 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:37.071182 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bafa24-cded-41ed-980c-c6cd3cc01439 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:37.079711 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:37.082439 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bafa24-cded-41ed-980c-c6cd3cc01439 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:37.084038 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bafa24-cded-41ed-980c-c6cd3cc01439 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:37.101839 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-e1bafa24-cded-41ed-980c-c6cd3cc01439 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:52:37.101839 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:37.101839 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:37.101839 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:37.101839 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:37.101839 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:37.101839 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:37.101839 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:37.101839 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:37.101839 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:37.101839 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:37.101839 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:37.101839 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 11:52:37.101839 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 11:52:37.101839 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 11:52:37.102784 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 11:52:37.102784 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:37.102784 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:37.102784 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:37.102784 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:37.102784 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:37.102784 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:37.102784 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:37.102784 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:52:37.102784 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:37.102784 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:37.102784 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:37.102784 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:37.102784 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:37.102784 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:37.102784 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:37.102784 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:37.103676 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 11:52:37.103676 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 11:52:37.103676 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:52:37.103676 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:52:37.103676 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 253/492] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:52:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:37.103988 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bafa24-cded-41ed-980c-c6cd3cc01439 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:37.121057 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:37.153526 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a9650d-597c-4996-bac2-1ee0758c8e35 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:37.186950 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7386eb02-6eac-4fae-89db-2d6372bede66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:37.187744 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386eb02-6eac-4fae-89db-2d6372bede66 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:37.188052 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386eb02-6eac-4fae-89db-2d6372bede66 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:37.188327 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386eb02-6eac-4fae-89db-2d6372bede66 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:37.195213 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7386eb02-6eac-4fae-89db-2d6372bede66 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:37.196665 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7386eb02-6eac-4fae-89db-2d6372bede66 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:37.207538 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bafa24-cded-41ed-980c-c6cd3cc01439 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:37.212651 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-7386eb02-6eac-4fae-89db-2d6372bede66 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 11:52:37.212651 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:37.212651 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:37.212651 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:37.212651 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:37.212651 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:37.212651 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:37.212651 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:37.212651 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:37.212651 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:37.212651 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:37.212651 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:37.212651 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 11:52:37.212651 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 11:52:37.212651 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 11:52:37.212651 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 11:52:37.214116 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:37.214116 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:37.214116 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 11:52:37.214116 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 11:52:37.214116 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 11:52:37.214116 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 11:52:37.214116 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:37.214116 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:37.214116 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:37.214116 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:37.214116 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:37.214116 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:52:37.214116 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:37.214116 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:37.214116 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:37.214116 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:37.214116 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:37.214116 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:37.215022 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:37.215022 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:37.215022 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 11:52:37.215022 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 11:52:37.215022 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 11:52:37.215022 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 11:52:37.215022 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 11:52:37.215022 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 11:52:37.215022 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 11:52:37.215022 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:52:37.215022 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 240/493] 10.222.0.44 () {56 vars in 1093 bytes} [Wed May 25 11:52:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:37.216047 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7386eb02-6eac-4fae-89db-2d6372bede66 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:37.253396 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea0844-4ef9-4b1c-b9ef-b8dc5459ff6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:37.254105 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea0844-4ef9-4b1c-b9ef-b8dc5459ff6b None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:37.254391 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea0844-4ef9-4b1c-b9ef-b8dc5459ff6b None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:37.254674 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea0844-4ef9-4b1c-b9ef-b8dc5459ff6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:37.265350 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeea0844-4ef9-4b1c-b9ef-b8dc5459ff6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:37.266815 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeea0844-4ef9-4b1c-b9ef-b8dc5459ff6b None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:37.284939 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-aeea0844-4ef9-4b1c-b9ef-b8dc5459ff6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:52:37.284939 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:37.284939 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:37.284939 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:37.284939 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:37.284939 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:37.284939 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:37.284939 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:37.284939 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:37.284939 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:37.284939 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:37.284939 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:37.284939 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 11:52:37.284939 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 11:52:37.284939 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 11:52:37.285847 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 11:52:37.285847 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:37.285847 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:37.285847 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:37.285847 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:37.285847 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:37.285847 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:37.285847 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:37.285847 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:52:37.285847 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:37.285847 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:37.285847 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:37.285847 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:37.285847 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:37.285847 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:37.285847 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:37.285847 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:37.286728 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 11:52:37.286728 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 11:52:37.286728 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:52:37.286728 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:52:37.286728 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 254/494] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:52:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:37.286991 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea0844-4ef9-4b1c-b9ef-b8dc5459ff6b None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:37.314025 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:37.326708 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7386eb02-6eac-4fae-89db-2d6372bede66 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:37.352700 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:37.361621 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9881f1e-5ba7-4828-9355-eb0844d6b150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:37.362425 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9881f1e-5ba7-4828-9355-eb0844d6b150 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:37.362710 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9881f1e-5ba7-4828-9355-eb0844d6b150 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:37.362986 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9881f1e-5ba7-4828-9355-eb0844d6b150 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:37.372858 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9881f1e-5ba7-4828-9355-eb0844d6b150 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:52:37.380640 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-a9881f1e-5ba7-4828-9355-eb0844d6b150 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 11:52:37.380640 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:37.380640 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:37.380640 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:37.380640 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:37.380640 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:37.380640 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:37.380640 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:37.380640 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:37.380640 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:37.380640 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:37.380640 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:37.380640 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:52:37.380640 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:52:37.380640 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:52:37.380640 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:52:37.381699 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:52:37.381699 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:52:37.381699 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:52:37.381699 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:52:37.381699 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:37.381699 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:37.381699 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:37.381699 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:37.381699 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:37.381699 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:37.381699 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:37.381699 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:52:37.381699 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:37.381699 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:37.381699 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:37.381699 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:37.382603 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:37.382603 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:37.382603 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:37.382603 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:37.382603 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:52:37.382603 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:52:37.382603 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:52:37.382603 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:52:37.382603 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:52:37.382603 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:52:37.382603 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 11:52:37.382603 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:52:37.382603 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 241/495] 10.222.0.44 () {56 vars in 1102 bytes} [Wed May 25 11:52:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:37.382603 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9881f1e-5ba7-4828-9355-eb0844d6b150 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:37.389622 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea0844-4ef9-4b1c-b9ef-b8dc5459ff6b None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:37.424438 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf71d8-637b-4585-9948-18789320d4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:37.425087 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf71d8-637b-4585-9948-18789320d4c2 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:37.425368 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf71d8-637b-4585-9948-18789320d4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:37.425636 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf71d8-637b-4585-9948-18789320d4c2 None admin] PATH_INFO: `/v3/domains` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:37.426334 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaf71d8-637b-4585-9948-18789320d4c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:37.426635 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaf71d8-637b-4585-9948-18789320d4c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:37.428029 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaf71d8-637b-4585-9948-18789320d4c2 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:37.439356 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 255/496] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 25 11:52:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:37.440153 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf71d8-637b-4585-9948-18789320d4c2 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:37.487735 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9881f1e-5ba7-4828-9355-eb0844d6b150 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:37.520355 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60fbce1-f746-4247-ad54-78ad7a3da617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:37.520958 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60fbce1-f746-4247-ad54-78ad7a3da617 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:37.521247 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60fbce1-f746-4247-ad54-78ad7a3da617 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:37.521779 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60fbce1-f746-4247-ad54-78ad7a3da617 None admin] PATH_INFO: `/v3/users` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:37.522605 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60fbce1-f746-4247-ad54-78ad7a3da617 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:37.522918 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60fbce1-f746-4247-ad54-78ad7a3da617 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:37.524388 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60fbce1-f746-4247-ad54-78ad7a3da617 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:37.539175 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf71d8-637b-4585-9948-18789320d4c2 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:37.561197 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 242/497] 10.222.0.44 () {56 vars in 1133 bytes} [Wed May 25 11:52:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:37.562027 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60fbce1-f746-4247-ad54-78ad7a3da617 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:37.564680 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:37.570898 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:37.574929 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229965c4-f1e0-490a-8245-ee2b7afaf33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:37.575597 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229965c4-f1e0-490a-8245-ee2b7afaf33d None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:37.575912 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229965c4-f1e0-490a-8245-ee2b7afaf33d None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:37.576200 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229965c4-f1e0-490a-8245-ee2b7afaf33d None admin] PATH_INFO: `/v3/domains` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:37.576919 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229965c4-f1e0-490a-8245-ee2b7afaf33d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:37.577232 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229965c4-f1e0-490a-8245-ee2b7afaf33d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:37.578595 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229965c4-f1e0-490a-8245-ee2b7afaf33d None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:37.590666 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 256/498] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 25 11:52:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:37.591542 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229965c4-f1e0-490a-8245-ee2b7afaf33d None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:37.664504 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60fbce1-f746-4247-ad54-78ad7a3da617 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:37.694382 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229965c4-f1e0-490a-8245-ee2b7afaf33d None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:37.696664 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb64f8-5497-4205-8497-67c87edc8e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:37.697352 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb64f8-5497-4205-8497-67c87edc8e68 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:37.697641 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb64f8-5497-4205-8497-67c87edc8e68 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:37.697917 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb64f8-5497-4205-8497-67c87edc8e68 None admin] PATH_INFO: `/v3/roles` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:37.698658 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdb64f8-5497-4205-8497-67c87edc8e68 None admin] RBAC: Adding query filter params (name=service) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:37.698966 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdb64f8-5497-4205-8497-67c87edc8e68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:37.700381 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdb64f8-5497-4205-8497-67c87edc8e68 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:37.708007 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 243/499] 10.222.0.44 () {56 vars in 1103 bytes} [Wed May 25 11:52:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:37.708790 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb64f8-5497-4205-8497-67c87edc8e68 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:37.727489 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e61a4-104d-43ee-9180-6907746405f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:37.728367 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e61a4-104d-43ee-9180-6907746405f2 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:37.729196 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e61a4-104d-43ee-9180-6907746405f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:37.729474 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e61a4-104d-43ee-9180-6907746405f2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:37.736329 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015e61a4-104d-43ee-9180-6907746405f2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:37.737744 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015e61a4-104d-43ee-9180-6907746405f2 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:37.753315 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-015e61a4-104d-43ee-9180-6907746405f2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 25 11:52:37.753315 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:37.753315 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:37.753315 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:37.753315 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:37.753315 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:37.753315 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:37.753315 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:37.753315 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:37.753315 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:37.753315 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:37.753315 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:37.753315 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 11:52:37.753315 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 11:52:37.753315 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 11:52:37.753315 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 11:52:37.754254 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:37.754254 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:37.754254 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 11:52:37.754254 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 11:52:37.754254 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 11:52:37.754254 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 11:52:37.754254 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:37.754254 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:37.754254 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:37.754254 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:37.754254 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:37.754254 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:52:37.754254 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:37.754254 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:37.754254 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:37.754254 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:37.754254 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:37.754254 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:37.755134 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:37.755134 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:37.755134 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 11:52:37.755134 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 11:52:37.755134 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 11:52:37.755134 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 11:52:37.755134 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 11:52:37.755134 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 11:52:37.755134 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 25 11:52:37.755134 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:52:37.755134 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 257/500] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 25 11:52:37 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:37.755949 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e61a4-104d-43ee-9180-6907746405f2 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:37.777832 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:37.801964 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:37.814754 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb64f8-5497-4205-8497-67c87edc8e68 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:37.848696 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b77c1e-58ad-4fdc-add1-f4a4b6f8d204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:37.849346 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b77c1e-58ad-4fdc-add1-f4a4b6f8d204 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:37.849634 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b77c1e-58ad-4fdc-add1-f4a4b6f8d204 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:37.849915 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b77c1e-58ad-4fdc-add1-f4a4b6f8d204 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:37.856460 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e61a4-104d-43ee-9180-6907746405f2 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:37.890429 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ab16e-ace5-4a0b-b776-3037fc8f9a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:37.891218 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ab16e-ace5-4a0b-b776-3037fc8f9a4f None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:37.891501 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ab16e-ace5-4a0b-b776-3037fc8f9a4f None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:37.891779 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ab16e-ace5-4a0b-b776-3037fc8f9a4f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:37.898974 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6ab16e-ace5-4a0b-b776-3037fc8f9a4f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:37.901011 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6ab16e-ace5-4a0b-b776-3037fc8f9a4f None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:37.915147 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-8a6ab16e-ace5-4a0b-b776-3037fc8f9a4f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 25 11:52:37.915147 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:37.915147 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:37.915147 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:37.915147 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:37.915147 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:37.915147 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:37.915147 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:37.915147 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:37.915147 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:37.915147 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:37.915147 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:37.915147 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 11:52:37.915147 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 11:52:37.915147 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 11:52:37.915147 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 11:52:37.922182 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:37.922182 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:37.922182 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 11:52:37.922182 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 11:52:37.922182 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 11:52:37.922182 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 11:52:37.922182 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:37.922182 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:37.922182 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:37.922182 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:37.922182 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:37.922182 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:52:37.922182 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:37.922182 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:37.922182 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:37.922182 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:37.922182 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:37.922182 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:37.923370 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:37.923370 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:37.923370 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 11:52:37.923370 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 11:52:37.923370 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 11:52:37.923370 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 11:52:37.923370 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 11:52:37.923370 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 11:52:37.923370 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 25 11:52:37.923370 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:52:37.924017 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b77c1e-58ad-4fdc-add1-f4a4b6f8d204 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:37.924101 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 258/501] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 25 11:52:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:37.924179 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b77c1e-58ad-4fdc-add1-f4a4b6f8d204 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:37.924255 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ab16e-ace5-4a0b-b776-3037fc8f9a4f None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:37.987367 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:38.018239 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ab16e-ace5-4a0b-b776-3037fc8f9a4f None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:38.021787 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 244/502] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 25 11:52:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 11:52:38.022603 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b77c1e-58ad-4fdc-add1-f4a4b6f8d204 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:38.026589 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:38.053532 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ccaad-6709-4bdd-a772-eea7227b6f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:38.054253 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ccaad-6709-4bdd-a772-eea7227b6f8b None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:38.054541 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ccaad-6709-4bdd-a772-eea7227b6f8b None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:38.054820 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ccaad-6709-4bdd-a772-eea7227b6f8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:38.064659 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ccaad-6709-4bdd-a772-eea7227b6f8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:38.066110 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ccaad-6709-4bdd-a772-eea7227b6f8b None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:38.084501 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-233ccaad-6709-4bdd-a772-eea7227b6f8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:52:38.084501 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:38.084501 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:38.084501 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:38.084501 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:38.084501 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:38.084501 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:38.084501 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:38.084501 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:38.084501 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:38.084501 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:38.084501 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:38.084501 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 11:52:38.084501 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 11:52:38.084501 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 11:52:38.085356 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 11:52:38.085356 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:38.085356 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:38.085356 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:38.085356 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:38.085356 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:38.085356 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:38.085356 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:38.085356 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:52:38.085356 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:38.085356 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:38.085356 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:38.085356 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:38.085356 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:38.085356 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:38.085356 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:38.085356 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:38.086196 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 11:52:38.086196 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 11:52:38.086196 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:52:38.086196 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:52:38.090215 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 259/503] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:52:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:38.090987 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ccaad-6709-4bdd-a772-eea7227b6f8b None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:38.119894 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b77c1e-58ad-4fdc-add1-f4a4b6f8d204 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:38.152613 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586cb92c-8bc3-4afb-a9fc-eb5de65c448d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:38.153282 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586cb92c-8bc3-4afb-a9fc-eb5de65c448d None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:38.153563 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586cb92c-8bc3-4afb-a9fc-eb5de65c448d None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:38.153839 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586cb92c-8bc3-4afb-a9fc-eb5de65c448d None admin] PATH_INFO: `/v3/users` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:38.154669 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586cb92c-8bc3-4afb-a9fc-eb5de65c448d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:38.154976 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586cb92c-8bc3-4afb-a9fc-eb5de65c448d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:38.156450 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586cb92c-8bc3-4afb-a9fc-eb5de65c448d None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:38.173564 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 245/504] 10.222.0.44 () {56 vars in 1137 bytes} [Wed May 25 11:52:38 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:38.174371 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586cb92c-8bc3-4afb-a9fc-eb5de65c448d None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:38.192119 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ccaad-6709-4bdd-a772-eea7227b6f8b None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:38.200648 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:38.225812 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b21e3a-ce28-4ca0-9d1e-63b92ad64bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:38.226468 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b21e3a-ce28-4ca0-9d1e-63b92ad64bc2 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:38.226749 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b21e3a-ce28-4ca0-9d1e-63b92ad64bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:38.227024 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b21e3a-ce28-4ca0-9d1e-63b92ad64bc2 None admin] PATH_INFO: `/v3/users` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:38.227870 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b21e3a-ce28-4ca0-9d1e-63b92ad64bc2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:38.228176 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b21e3a-ce28-4ca0-9d1e-63b92ad64bc2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:38.230194 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b21e3a-ce28-4ca0-9d1e-63b92ad64bc2 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:38.264832 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 260/505] 10.222.0.44 () {56 vars in 1137 bytes} [Wed May 25 11:52:38 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:38.265663 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b21e3a-ce28-4ca0-9d1e-63b92ad64bc2 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:38.273371 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586cb92c-8bc3-4afb-a9fc-eb5de65c448d None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:38.283733 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:38.308037 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc34b2c-6e38-43df-bf62-936d98e1cc43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:38.308767 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc34b2c-6e38-43df-bf62-936d98e1cc43 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:38.309086 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc34b2c-6e38-43df-bf62-936d98e1cc43 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:38.309326 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc34b2c-6e38-43df-bf62-936d98e1cc43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:38.319033 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc34b2c-6e38-43df-bf62-936d98e1cc43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:38.320512 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc34b2c-6e38-43df-bf62-936d98e1cc43 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:38.338602 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-1fc34b2c-6e38-43df-bf62-936d98e1cc43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:52:38.338602 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:38.338602 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:38.338602 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:38.338602 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:38.338602 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:38.338602 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:38.338602 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:38.338602 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:38.338602 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:38.338602 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:38.338602 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:38.338602 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 11:52:38.338602 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 11:52:38.338602 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 11:52:38.339595 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 11:52:38.339595 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:38.339595 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:38.339595 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:38.339595 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:38.339595 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:38.339595 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:38.339595 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:38.339595 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:52:38.339595 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:38.339595 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:38.339595 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:38.339595 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:38.339595 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:38.339595 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:38.339595 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:38.339595 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:38.340489 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 11:52:38.340489 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 11:52:38.340489 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:52:38.340489 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:52:38.340489 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 246/506] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:52:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:38.340764 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc34b2c-6e38-43df-bf62-936d98e1cc43 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:38.367755 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b21e3a-ce28-4ca0-9d1e-63b92ad64bc2 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:38.403774 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3238079-a847-415c-bbe9-3e90187c29f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:38.404471 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3238079-a847-415c-bbe9-3e90187c29f4 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:38.404750 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3238079-a847-415c-bbe9-3e90187c29f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:38.405022 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3238079-a847-415c-bbe9-3e90187c29f4 None admin] PATH_INFO: `/v3/domains` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:38.405753 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3238079-a847-415c-bbe9-3e90187c29f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:38.406058 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3238079-a847-415c-bbe9-3e90187c29f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:38.407459 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3238079-a847-415c-bbe9-3e90187c29f4 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:38.420340 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 261/507] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 25 11:52:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:38.421208 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3238079-a847-415c-bbe9-3e90187c29f4 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:38.500081 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:38.523043 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3238079-a847-415c-bbe9-3e90187c29f4 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:38.534406 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:38.559439 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b1af7d-7077-451e-8e20-98a0c2c2bab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:38.559647 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc34b2c-6e38-43df-bf62-936d98e1cc43 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:38.560045 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b1af7d-7077-451e-8e20-98a0c2c2bab6 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:38.560327 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b1af7d-7077-451e-8e20-98a0c2c2bab6 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:38.560603 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b1af7d-7077-451e-8e20-98a0c2c2bab6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:38.593237 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb15bab-84f4-4e01-ac8a-4a91ad33c83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:38.593883 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb15bab-84f4-4e01-ac8a-4a91ad33c83c None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:38.594167 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb15bab-84f4-4e01-ac8a-4a91ad33c83c None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:38.594447 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb15bab-84f4-4e01-ac8a-4a91ad33c83c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:38.650771 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b1af7d-7077-451e-8e20-98a0c2c2bab6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:38.652428 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b1af7d-7077-451e-8e20-98a0c2c2bab6 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:38.660679 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb15bab-84f4-4e01-ac8a-4a91ad33c83c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:38.662120 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb15bab-84f4-4e01-ac8a-4a91ad33c83c None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:38.725566 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:38.737865 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:38.750738 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 262/508] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 25 11:52:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 11:52:38.751554 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b1af7d-7077-451e-8e20-98a0c2c2bab6 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:38.765511 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 247/509] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 25 11:52:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 11:52:38.766340 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb15bab-84f4-4e01-ac8a-4a91ad33c83c None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:38.853401 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b1af7d-7077-451e-8e20-98a0c2c2bab6 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:38.866708 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb15bab-84f4-4e01-ac8a-4a91ad33c83c None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:38.887259 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0920e9-fd4e-49e9-8c4e-a2129d09c7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:38.888010 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0920e9-fd4e-49e9-8c4e-a2129d09c7e7 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:38.888289 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0920e9-fd4e-49e9-8c4e-a2129d09c7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:38.888563 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0920e9-fd4e-49e9-8c4e-a2129d09c7e7 None admin] PATH_INFO: `/v3/domains` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:38.889281 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0920e9-fd4e-49e9-8c4e-a2129d09c7e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:38.889583 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0920e9-fd4e-49e9-8c4e-a2129d09c7e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:38.890960 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0920e9-fd4e-49e9-8c4e-a2129d09c7e7 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:38.900156 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f234aa97-cedb-4766-8b8d-543545c9da4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:38.900984 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234aa97-cedb-4766-8b8d-543545c9da4e None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:38.901261 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234aa97-cedb-4766-8b8d-543545c9da4e None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:38.901558 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234aa97-cedb-4766-8b8d-543545c9da4e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:38.902438 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 263/510] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 25 11:52:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:38.903229 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0920e9-fd4e-49e9-8c4e-a2129d09c7e7 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:38.917047 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f234aa97-cedb-4766-8b8d-543545c9da4e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:38.919329 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f234aa97-cedb-4766-8b8d-543545c9da4e None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:38.939421 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-f234aa97-cedb-4766-8b8d-543545c9da4e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 25 11:52:38.939421 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:38.939421 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:38.939421 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:38.939421 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:38.939421 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:38.939421 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:38.939421 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:38.939421 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:38.939421 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:38.939421 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:38.939421 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:38.939421 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 11:52:38.939421 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 11:52:38.939421 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 11:52:38.939421 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 11:52:38.940447 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:38.940447 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:38.940447 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 11:52:38.940447 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 11:52:38.940447 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 11:52:38.940447 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 11:52:38.940447 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:38.940447 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:38.940447 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:38.940447 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:38.940447 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:38.940447 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:52:38.940447 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:38.940447 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:38.940447 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:38.940447 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:38.940447 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:38.940447 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:38.941396 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:38.941396 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:38.941396 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 11:52:38.941396 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 11:52:38.941396 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 11:52:38.941396 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 11:52:38.941396 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 11:52:38.941396 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 11:52:38.941396 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 25 11:52:38.941396 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:52:38.941396 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 248/511] 10.222.0.44 () {56 vars in 1102 bytes} [Wed May 25 11:52:38 2022] GET /identity/v3/users/neutron => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:38.944244 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f234aa97-cedb-4766-8b8d-543545c9da4e None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:38.945586 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:38.989297 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:39.009107 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0920e9-fd4e-49e9-8c4e-a2129d09c7e7 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:39.042297 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914d5bb-e051-4134-af0e-671615a788a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:39.043086 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914d5bb-e051-4134-af0e-671615a788a4 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:39.043370 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914d5bb-e051-4134-af0e-671615a788a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:39.043650 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914d5bb-e051-4134-af0e-671615a788a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:39.048508 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f234aa97-cedb-4766-8b8d-543545c9da4e None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:39.053923 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9914d5bb-e051-4134-af0e-671615a788a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:39.055358 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9914d5bb-e051-4134-af0e-671615a788a4 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:39.072029 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-9914d5bb-e051-4134-af0e-671615a788a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:52:39.072029 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:39.072029 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:39.072029 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:39.072029 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:39.072029 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:39.072029 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:39.072029 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:39.072029 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:39.072029 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:39.072029 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:39.072029 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:39.072029 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 11:52:39.072029 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 11:52:39.072029 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 11:52:39.072993 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 11:52:39.072993 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:39.072993 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:39.072993 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:39.072993 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:39.072993 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:39.072993 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:39.072993 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:39.072993 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:52:39.072993 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:39.072993 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:39.072993 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:39.072993 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:39.072993 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:39.072993 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:39.072993 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:39.072993 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:39.073992 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 11:52:39.073992 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 11:52:39.073992 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:52:39.073992 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:52:39.073992 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 264/512] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:52:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:39.074326 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914d5bb-e051-4134-af0e-671615a788a4 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:39.083297 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04cf9d0-9a15-407c-8de2-ea957acac9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:39.084125 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04cf9d0-9a15-407c-8de2-ea957acac9ef None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:39.084473 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04cf9d0-9a15-407c-8de2-ea957acac9ef None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:39.084757 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04cf9d0-9a15-407c-8de2-ea957acac9ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:39.095098 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04cf9d0-9a15-407c-8de2-ea957acac9ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:39.096574 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04cf9d0-9a15-407c-8de2-ea957acac9ef None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:39.114593 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-e04cf9d0-9a15-407c-8de2-ea957acac9ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:52:39.114593 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:39.114593 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:39.114593 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:39.114593 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:39.114593 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:39.114593 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:39.114593 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:39.114593 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:39.114593 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:39.114593 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:39.114593 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:39.114593 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 11:52:39.114593 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 11:52:39.114593 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 11:52:39.115596 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 11:52:39.115596 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:39.115596 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:39.115596 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:39.115596 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:39.115596 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:39.115596 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:39.115596 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:39.115596 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:52:39.115596 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:39.115596 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:39.115596 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:39.115596 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:39.115596 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:39.115596 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:39.115596 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:39.115596 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:39.117032 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 11:52:39.117032 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 11:52:39.117032 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:52:39.117032 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:52:39.117032 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 249/513] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:52:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:39.117032 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04cf9d0-9a15-407c-8de2-ea957acac9ef None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:39.162378 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:39.176627 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914d5bb-e051-4134-af0e-671615a788a4 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:39.210005 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0ad62-624f-4229-b5d0-f3b4c645a619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:39.210789 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0ad62-624f-4229-b5d0-f3b4c645a619 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:39.211077 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0ad62-624f-4229-b5d0-f3b4c645a619 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:39.211193 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:39.211346 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0ad62-624f-4229-b5d0-f3b4c645a619 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:39.218655 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f0ad62-624f-4229-b5d0-f3b4c645a619 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:39.220124 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f0ad62-624f-4229-b5d0-f3b4c645a619 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:39.221682 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04cf9d0-9a15-407c-8de2-ea957acac9ef None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:39.235169 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-e1f0ad62-624f-4229-b5d0-f3b4c645a619 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 11:52:39.235169 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:39.235169 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:39.235169 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:39.235169 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:39.235169 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:39.235169 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:39.235169 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:39.235169 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:39.235169 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:39.235169 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:39.235169 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:39.235169 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 11:52:39.235169 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 11:52:39.235169 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 11:52:39.236196 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 11:52:39.236196 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:39.236196 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:39.236196 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:39.236196 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:39.236196 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:39.236196 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:39.236196 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:39.236196 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:52:39.236196 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:39.236196 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:39.236196 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:39.236196 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:39.236196 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:39.236196 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:39.236196 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:39.236196 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:39.237100 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 11:52:39.237100 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 11:52:39.237100 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 11:52:39.237100 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 11:52:39.237100 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 11:52:39.237100 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 11:52:39.237100 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 11:52:39.237100 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:52:39.237100 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 265/514] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 25 11:52:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:39.237561 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0ad62-624f-4229-b5d0-f3b4c645a619 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:39.259198 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3db568-3967-4b50-b6e0-648fc9d13316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:39.259908 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3db568-3967-4b50-b6e0-648fc9d13316 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:39.260199 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3db568-3967-4b50-b6e0-648fc9d13316 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:39.260481 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3db568-3967-4b50-b6e0-648fc9d13316 None admin] PATH_INFO: `/v3/users` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:39.261318 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3db568-3967-4b50-b6e0-648fc9d13316 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:39.261633 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3db568-3967-4b50-b6e0-648fc9d13316 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:39.263073 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3db568-3967-4b50-b6e0-648fc9d13316 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:39.281508 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 250/515] 10.222.0.44 () {56 vars in 1139 bytes} [Wed May 25 11:52:39 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:39.289912 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3db568-3967-4b50-b6e0-648fc9d13316 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:39.350283 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0ad62-624f-4229-b5d0-f3b4c645a619 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:39.383213 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149201fa-48a6-47ba-b039-fbf4d420e068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:39.383818 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149201fa-48a6-47ba-b039-fbf4d420e068 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:39.384128 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149201fa-48a6-47ba-b039-fbf4d420e068 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:39.384381 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149201fa-48a6-47ba-b039-fbf4d420e068 None admin] PATH_INFO: `/v3/domains` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:39.385250 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3db568-3967-4b50-b6e0-648fc9d13316 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:39.385654 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149201fa-48a6-47ba-b039-fbf4d420e068 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:39.385959 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149201fa-48a6-47ba-b039-fbf4d420e068 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:39.387324 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149201fa-48a6-47ba-b039-fbf4d420e068 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:39.398541 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 266/516] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 25 11:52:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:39.399351 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149201fa-48a6-47ba-b039-fbf4d420e068 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:39.410649 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:39.421635 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d0fd4-1331-4263-84b5-9e493814e03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:39.422306 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d0fd4-1331-4263-84b5-9e493814e03f None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:39.422596 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d0fd4-1331-4263-84b5-9e493814e03f None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:39.423036 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d0fd4-1331-4263-84b5-9e493814e03f None admin] PATH_INFO: `/v3/domains` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:39.423765 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d0fd4-1331-4263-84b5-9e493814e03f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:39.424109 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d0fd4-1331-4263-84b5-9e493814e03f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:39.425478 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d0fd4-1331-4263-84b5-9e493814e03f None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:39.436443 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 251/517] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 25 11:52:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:39.437228 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d0fd4-1331-4263-84b5-9e493814e03f None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:39.448681 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:39.499075 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149201fa-48a6-47ba-b039-fbf4d420e068 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:39.532746 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d65e5-e8d5-4541-b4bd-529fa4bcc2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:39.533477 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d65e5-e8d5-4541-b4bd-529fa4bcc2a4 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:39.533763 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d65e5-e8d5-4541-b4bd-529fa4bcc2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:39.534042 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d65e5-e8d5-4541-b4bd-529fa4bcc2a4 None admin] PATH_INFO: `/v3/projects` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:39.534813 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49d65e5-e8d5-4541-b4bd-529fa4bcc2a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:39.535122 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49d65e5-e8d5-4541-b4bd-529fa4bcc2a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:39.536585 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49d65e5-e8d5-4541-b4bd-529fa4bcc2a4 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:39.536785 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d0fd4-1331-4263-84b5-9e493814e03f None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:39.554606 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 267/518] 10.222.0.44 () {56 vars in 1148 bytes} [Wed May 25 11:52:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:39.555415 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d65e5-e8d5-4541-b4bd-529fa4bcc2a4 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:39.570354 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb00797-f853-43fd-8a44-489ed1b4a042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:39.571067 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb00797-f853-43fd-8a44-489ed1b4a042 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:39.571359 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb00797-f853-43fd-8a44-489ed1b4a042 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:39.571638 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb00797-f853-43fd-8a44-489ed1b4a042 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:39.637676 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:39.648840 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb00797-f853-43fd-8a44-489ed1b4a042 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:39.650323 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb00797-f853-43fd-8a44-489ed1b4a042 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:39.660431 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:39.671435 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d65e5-e8d5-4541-b4bd-529fa4bcc2a4 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:39.705736 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d92668-1492-4288-bdc2-b2e3ba5ba04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:39.706519 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d92668-1492-4288-bdc2-b2e3ba5ba04d None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:39.706805 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d92668-1492-4288-bdc2-b2e3ba5ba04d None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:39.707073 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d92668-1492-4288-bdc2-b2e3ba5ba04d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:39.714203 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d92668-1492-4288-bdc2-b2e3ba5ba04d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:39.715626 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d92668-1492-4288-bdc2-b2e3ba5ba04d None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:39.729776 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-90d92668-1492-4288-bdc2-b2e3ba5ba04d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 11:52:39.729776 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:39.729776 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:39.729776 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:39.729776 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:39.729776 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:39.729776 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:39.729776 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:39.729776 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:39.729776 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:39.729776 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:39.729776 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:39.729776 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 11:52:39.729776 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 11:52:39.729776 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 11:52:39.730749 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 11:52:39.730749 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:39.730749 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:39.730749 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:39.730749 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:39.730749 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:39.730749 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:39.730749 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:39.730749 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:52:39.730749 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:39.730749 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:39.730749 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:39.730749 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:39.730749 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:39.730749 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:39.730749 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:39.730749 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:39.731615 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 11:52:39.731615 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 11:52:39.731615 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 11:52:39.731615 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 11:52:39.731615 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 11:52:39.731615 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 11:52:39.731615 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 11:52:39.731615 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:52:39.731615 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 268/519] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 25 11:52:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:39.732126 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d92668-1492-4288-bdc2-b2e3ba5ba04d None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:39.757836 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 252/520] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 25 11:52:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 11:52:39.757836 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb00797-f853-43fd-8a44-489ed1b4a042 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:39.831112 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d92668-1492-4288-bdc2-b2e3ba5ba04d None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:39.852696 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb00797-f853-43fd-8a44-489ed1b4a042 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:39.857963 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:39.862343 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:39.866683 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c09de-8473-4d67-a2a4-d140c5328b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:39.867472 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c09de-8473-4d67-a2a4-d140c5328b70 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:39.867758 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c09de-8473-4d67-a2a4-d140c5328b70 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:39.868066 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c09de-8473-4d67-a2a4-d140c5328b70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:39.874815 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497c09de-8473-4d67-a2a4-d140c5328b70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:39.876311 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497c09de-8473-4d67-a2a4-d140c5328b70 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:39.887236 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff040d3-f3b7-44d1-b208-041b757a67e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:39.887977 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff040d3-f3b7-44d1-b208-041b757a67e8 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:39.888246 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff040d3-f3b7-44d1-b208-041b757a67e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:39.888526 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff040d3-f3b7-44d1-b208-041b757a67e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:39.889353 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff040d3-f3b7-44d1-b208-041b757a67e8 None admin] RBAC: Adding query filter params (role.id=33fd4a41fa554c6699a6c832f8eb793e, scope.project.id=57e08d47948142978437098a8120be78, user.id=d25d7a439361492d8d7ba018531a2e7a) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:39.889670 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff040d3-f3b7-44d1-b208-041b757a67e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:39.890434 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-497c09de-8473-4d67-a2a4-d140c5328b70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 11:52:39.890434 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:39.890434 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:39.890434 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:39.890434 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:39.890434 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:39.890434 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:39.890434 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:39.890434 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:39.890434 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:39.890434 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:39.890434 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:39.890434 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 11:52:39.890434 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 11:52:39.890434 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 11:52:39.891357 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 11:52:39.891357 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:39.891357 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:39.891357 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:39.891357 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:39.891357 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:39.891357 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:39.891357 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:39.891357 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:52:39.891357 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:39.891357 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:39.891357 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:39.891357 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:39.891357 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:39.891357 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:39.891357 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:39.891357 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:39.897323 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 11:52:39.897323 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 11:52:39.897323 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 11:52:39.897323 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 11:52:39.897323 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 11:52:39.897323 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 11:52:39.897323 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 11:52:39.897323 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:52:39.897742 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff040d3-f3b7-44d1-b208-041b757a67e8 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:39.897812 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 269/521] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 25 11:52:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:39.897812 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c09de-8473-4d67-a2a4-d140c5328b70 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:39.898167 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 253/522] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 25 11:52:39 2022] GET /identity/v3/role_assignments?user.id=d25d7a439361492d8d7ba018531a2e7a&scope.project.id=57e08d47948142978437098a8120be78&role.id=33fd4a41fa554c6699a6c832f8eb793e => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:39.898621 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff040d3-f3b7-44d1-b208-041b757a67e8 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:40.037281 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c09de-8473-4d67-a2a4-d140c5328b70 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:40.037673 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff040d3-f3b7-44d1-b208-041b757a67e8 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:40.075998 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78904848-6ce5-4381-a90c-6c89e9da06e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:40.076920 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78904848-6ce5-4381-a90c-6c89e9da06e4 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:40.077212 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78904848-6ce5-4381-a90c-6c89e9da06e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:40.077488 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78904848-6ce5-4381-a90c-6c89e9da06e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:40.079316 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc85a7db-c2d4-46b7-a3fd-19980b404abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:40.080031 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85a7db-c2d4-46b7-a3fd-19980b404abb None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:40.080281 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85a7db-c2d4-46b7-a3fd-19980b404abb None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:40.080556 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85a7db-c2d4-46b7-a3fd-19980b404abb None admin] PATH_INFO: `/v3/projects` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:40.081344 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc85a7db-c2d4-46b7-a3fd-19980b404abb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:40.081654 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc85a7db-c2d4-46b7-a3fd-19980b404abb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:40.083092 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc85a7db-c2d4-46b7-a3fd-19980b404abb None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:40.091429 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78904848-6ce5-4381-a90c-6c89e9da06e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:40.093275 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78904848-6ce5-4381-a90c-6c89e9da06e4 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:40.097534 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 270/523] 10.222.0.44 () {56 vars in 1148 bytes} [Wed May 25 11:52:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:40.098437 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc85a7db-c2d4-46b7-a3fd-19980b404abb None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:40.111156 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-78904848-6ce5-4381-a90c-6c89e9da06e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:52:40.111156 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:40.111156 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:40.111156 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:40.111156 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:40.111156 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:40.111156 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:40.111156 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:40.111156 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:40.111156 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:40.111156 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:40.111156 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:40.111156 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 11:52:40.111156 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 11:52:40.111156 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 11:52:40.112256 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 11:52:40.112256 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:40.112256 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:40.112256 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:40.112256 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:40.112256 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:40.112256 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:40.112256 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:40.112256 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:52:40.112256 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:40.112256 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:40.112256 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:40.112256 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:40.112256 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:40.112256 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:40.112256 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:40.112256 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:40.113206 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 11:52:40.113206 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 11:52:40.113206 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:52:40.113206 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:52:40.113206 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 254/524] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:52:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:40.113530 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78904848-6ce5-4381-a90c-6c89e9da06e4 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:40.144022 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:40.158550 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:40.216075 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc85a7db-c2d4-46b7-a3fd-19980b404abb None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:40.231459 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78904848-6ce5-4381-a90c-6c89e9da06e4 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:40.249506 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ef07b-965a-40bc-8001-879fc9dbb42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:40.250456 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ef07b-965a-40bc-8001-879fc9dbb42c None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:40.251003 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ef07b-965a-40bc-8001-879fc9dbb42c None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:40.251411 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ef07b-965a-40bc-8001-879fc9dbb42c None admin] PATH_INFO: `/v3/projects` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:40.252672 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7ef07b-965a-40bc-8001-879fc9dbb42c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:40.253139 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7ef07b-965a-40bc-8001-879fc9dbb42c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:40.255368 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7ef07b-965a-40bc-8001-879fc9dbb42c None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:40.267997 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6af7c0-fb9b-4d83-9b43-8d3e2430b454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:40.269090 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6af7c0-fb9b-4d83-9b43-8d3e2430b454 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:40.269562 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6af7c0-fb9b-4d83-9b43-8d3e2430b454 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:40.270026 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6af7c0-fb9b-4d83-9b43-8d3e2430b454 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:40.271071 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6af7c0-fb9b-4d83-9b43-8d3e2430b454 None admin] RBAC: Adding query filter params (role.id=33fd4a41fa554c6699a6c832f8eb793e, scope.project.id=57e08d47948142978437098a8120be78, user.id=9c940de37d2d453c875d3ab6c077a331) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:40.271853 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6af7c0-fb9b-4d83-9b43-8d3e2430b454 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:40.273298 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 271/525] 10.222.0.44 () {56 vars in 1148 bytes} [Wed May 25 11:52:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:40.273681 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6af7c0-fb9b-4d83-9b43-8d3e2430b454 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:40.274134 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ef07b-965a-40bc-8001-879fc9dbb42c None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:40.291826 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 255/526] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 25 11:52:40 2022] GET /identity/v3/role_assignments?user.id=9c940de37d2d453c875d3ab6c077a331&scope.project.id=57e08d47948142978437098a8120be78&role.id=33fd4a41fa554c6699a6c832f8eb793e => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:40.291826 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6af7c0-fb9b-4d83-9b43-8d3e2430b454 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:40.395308 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:40.407811 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ef07b-965a-40bc-8001-879fc9dbb42c None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:40.423825 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6af7c0-fb9b-4d83-9b43-8d3e2430b454 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:40.424055 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:40.445864 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8c99c2-490a-4394-88c7-9f6ead265da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:40.446535 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c99c2-490a-4394-88c7-9f6ead265da6 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:40.446893 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c99c2-490a-4394-88c7-9f6ead265da6 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:40.447917 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c99c2-490a-4394-88c7-9f6ead265da6 None admin] PATH_INFO: `/v3/domains` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:40.448689 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8c99c2-490a-4394-88c7-9f6ead265da6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:40.449000 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8c99c2-490a-4394-88c7-9f6ead265da6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:40.450405 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8c99c2-490a-4394-88c7-9f6ead265da6 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:40.457398 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae2e52-a829-4766-9b2d-5fe7eb2c4eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:40.458636 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae2e52-a829-4766-9b2d-5fe7eb2c4eec None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:40.458938 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae2e52-a829-4766-9b2d-5fe7eb2c4eec None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:40.459218 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae2e52-a829-4766-9b2d-5fe7eb2c4eec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:40.460540 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ae2e52-a829-4766-9b2d-5fe7eb2c4eec None admin] RBAC: Adding query filter params (role.id=33fd4a41fa554c6699a6c832f8eb793e, scope.project.id=57e08d47948142978437098a8120be78, user.id=bda1409f24a24f51b42043933e30a560) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:40.460869 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ae2e52-a829-4766-9b2d-5fe7eb2c4eec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:40.462716 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ae2e52-a829-4766-9b2d-5fe7eb2c4eec None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:40.463780 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 272/527] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 25 11:52:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:40.469067 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8c99c2-490a-4394-88c7-9f6ead265da6 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:40.475944 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 256/528] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 25 11:52:40 2022] GET /identity/v3/role_assignments?user.id=bda1409f24a24f51b42043933e30a560&scope.project.id=57e08d47948142978437098a8120be78&role.id=33fd4a41fa554c6699a6c832f8eb793e => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:40.589852 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8c99c2-490a-4394-88c7-9f6ead265da6 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:40.626811 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6524393b-bd34-4c53-adc6-4147b4c8a4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:40.627632 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524393b-bd34-4c53-adc6-4147b4c8a4f4 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:40.627953 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524393b-bd34-4c53-adc6-4147b4c8a4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:40.628227 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524393b-bd34-4c53-adc6-4147b4c8a4f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:40.636634 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6524393b-bd34-4c53-adc6-4147b4c8a4f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:40.638181 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6524393b-bd34-4c53-adc6-4147b4c8a4f4 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:40.654283 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-6524393b-bd34-4c53-adc6-4147b4c8a4f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 11:52:40.654283 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:40.654283 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:40.654283 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:40.654283 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:40.654283 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:40.654283 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:40.654283 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:40.654283 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:40.654283 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:40.654283 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:40.654283 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:40.654283 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 11:52:40.654283 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 11:52:40.654283 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 11:52:40.655205 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 11:52:40.655205 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:40.655205 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:40.655205 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:40.655205 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:40.655205 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:40.655205 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:40.655205 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:40.655205 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:52:40.655205 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:40.655205 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:40.655205 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:40.655205 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:40.655205 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:40.655205 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:40.655205 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:40.655205 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:40.656177 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 11:52:40.656177 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 11:52:40.656177 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 11:52:40.656177 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 11:52:40.656177 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 11:52:40.656177 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 11:52:40.656177 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 11:52:40.656177 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:52:40.656177 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 273/529] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 25 11:52:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:40.661381 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae2e52-a829-4766-9b2d-5fe7eb2c4eec None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:40.767307 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae2e52-a829-4766-9b2d-5fe7eb2c4eec None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:40.801886 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b487c8-d3cf-4c76-b65e-f7a20599c466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:40.802548 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b487c8-d3cf-4c76-b65e-f7a20599c466 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:40.802831 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b487c8-d3cf-4c76-b65e-f7a20599c466 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:40.803106 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b487c8-d3cf-4c76-b65e-f7a20599c466 None admin] PATH_INFO: `/v3/projects` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:40.803906 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b487c8-d3cf-4c76-b65e-f7a20599c466 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:40.804216 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b487c8-d3cf-4c76-b65e-f7a20599c466 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:40.805644 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b487c8-d3cf-4c76-b65e-f7a20599c466 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:40.828412 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 257/530] 10.222.0.44 () {56 vars in 1148 bytes} [Wed May 25 11:52:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:40.831017 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6524393b-bd34-4c53-adc6-4147b4c8a4f4 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:40.863904 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:40.939759 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6524393b-bd34-4c53-adc6-4147b4c8a4f4 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:40.973264 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e455935-6de5-4094-a460-d2b2b30b5745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:40.973918 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e455935-6de5-4094-a460-d2b2b30b5745 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:40.974200 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e455935-6de5-4094-a460-d2b2b30b5745 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:40.974474 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e455935-6de5-4094-a460-d2b2b30b5745 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:40.975297 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e455935-6de5-4094-a460-d2b2b30b5745 None admin] RBAC: Adding query filter params (role.id=33fd4a41fa554c6699a6c832f8eb793e, scope.project.id=57e08d47948142978437098a8120be78, user.id=be63af25271b49b5903e8fe66a62b1d2) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:40.975603 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e455935-6de5-4094-a460-d2b2b30b5745 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:40.977065 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e455935-6de5-4094-a460-d2b2b30b5745 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:40.987918 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 274/531] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 25 11:52:40 2022] GET /identity/v3/role_assignments?user.id=be63af25271b49b5903e8fe66a62b1d2&scope.project.id=57e08d47948142978437098a8120be78&role.id=33fd4a41fa554c6699a6c832f8eb793e => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:42.189579 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02160f27-5627-4e8d-ba5a-4f48de8a31fd None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:42.190017 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02160f27-5627-4e8d-ba5a-4f48de8a31fd None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:42.190234 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02160f27-5627-4e8d-ba5a-4f48de8a31fd None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:42.191751 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 258/532] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:52:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:52:42.197368 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e6057-19a1-48d4-b61b-6f4e5602e908 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:42.197797 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e6057-19a1-48d4-b61b-6f4e5602e908 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:42.197988 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e6057-19a1-48d4-b61b-6f4e5602e908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:42.215288 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-c70e6057-19a1-48d4-b61b-6f4e5602e908 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:52:42.216510 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-c70e6057-19a1-48d4-b61b-6f4e5602e908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:52:42.287206 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 275/533] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:52:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 11:52:42.310461 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02160f27-5627-4e8d-ba5a-4f48de8a31fd None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:42.326502 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:42.421299 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02160f27-5627-4e8d-ba5a-4f48de8a31fd None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:42.455224 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff56071-178b-4c50-97d3-b16f34b099f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:42.455979 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff56071-178b-4c50-97d3-b16f34b099f0 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:42.456266 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff56071-178b-4c50-97d3-b16f34b099f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:42.456540 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff56071-178b-4c50-97d3-b16f34b099f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:42.469767 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff56071-178b-4c50-97d3-b16f34b099f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:52:42.477847 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-cff56071-178b-4c50-97d3-b16f34b099f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 11:52:42.477847 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:42.477847 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:42.477847 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:42.477847 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:42.477847 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:42.477847 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:42.477847 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:42.477847 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:42.477847 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:42.477847 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:42.477847 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:42.477847 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:52:42.477847 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:52:42.477847 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:52:42.477847 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:52:42.479419 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:52:42.479419 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:52:42.479419 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:52:42.479419 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:52:42.479419 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:42.479419 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:42.479419 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:42.479419 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:42.479419 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:42.479419 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:42.479419 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:42.479419 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:52:42.479419 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:42.479419 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:42.479419 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:42.479419 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:42.480276 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:42.480276 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:42.480276 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:42.480276 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:42.480276 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:52:42.480276 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:52:42.480276 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:52:42.480276 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:52:42.480276 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:52:42.480276 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:52:42.480276 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 11:52:42.480276 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:52:42.480276 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 259/534] 10.222.0.44 () {56 vars in 1102 bytes} [Wed May 25 11:52:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:42.485667 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e6057-19a1-48d4-b61b-6f4e5602e908 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:42.510801 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:42.591017 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e6057-19a1-48d4-b61b-6f4e5602e908 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:42.627063 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19a5f48-3494-4c57-9fe1-95974319cb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:42.628150 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a5f48-3494-4c57-9fe1-95974319cb35 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:42.628645 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a5f48-3494-4c57-9fe1-95974319cb35 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:42.629126 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a5f48-3494-4c57-9fe1-95974319cb35 None admin] PATH_INFO: `/v3/roles` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:42.630096 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19a5f48-3494-4c57-9fe1-95974319cb35 None admin] RBAC: Adding query filter params (name=service) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:42.630623 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19a5f48-3494-4c57-9fe1-95974319cb35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:42.632234 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19a5f48-3494-4c57-9fe1-95974319cb35 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:42.641930 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 276/535] 10.222.0.44 () {56 vars in 1103 bytes} [Wed May 25 11:52:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:42.648997 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff56071-178b-4c50-97d3-b16f34b099f0 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:42.680178 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96432703-64a0-49ab-90c4-330731e2d893 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:42.680485 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96432703-64a0-49ab-90c4-330731e2d893 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:42.680754 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96432703-64a0-49ab-90c4-330731e2d893 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:42.682835 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 277/536] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:52:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:52:42.687834 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca42f1-039f-47c5-9b07-f04d52bb49c0 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:42.688154 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca42f1-039f-47c5-9b07-f04d52bb49c0 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:42.688443 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca42f1-039f-47c5-9b07-f04d52bb49c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:42.705087 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-c9ca42f1-039f-47c5-9b07-f04d52bb49c0 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:52:42.706332 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-c9ca42f1-039f-47c5-9b07-f04d52bb49c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:52:42.736603 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:42.768897 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff56071-178b-4c50-97d3-b16f34b099f0 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:42.783894 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 278/537] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:52:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 11:52:42.813716 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca42f1-039f-47c5-9b07-f04d52bb49c0 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:42.824304 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac074e-0d4f-496c-b554-c0ecb1b279e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:42.825499 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac074e-0d4f-496c-b554-c0ecb1b279e8 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:42.826023 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac074e-0d4f-496c-b554-c0ecb1b279e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:42.826509 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac074e-0d4f-496c-b554-c0ecb1b279e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:42.828917 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:42.840983 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dac074e-0d4f-496c-b554-c0ecb1b279e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:42.842963 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dac074e-0d4f-496c-b554-c0ecb1b279e8 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:42.864417 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-4dac074e-0d4f-496c-b554-c0ecb1b279e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:52:42.864417 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:42.864417 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:42.864417 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:42.864417 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:42.864417 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:42.864417 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:42.864417 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:42.864417 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:42.864417 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:42.864417 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:42.864417 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:42.864417 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 11:52:42.864417 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 11:52:42.864417 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 11:52:42.865610 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 11:52:42.865610 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:42.865610 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:42.865610 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:42.865610 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:42.865610 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:42.865610 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:42.865610 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:42.865610 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:52:42.865610 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:42.865610 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:42.865610 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:42.865610 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:42.865610 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:42.865610 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:42.865610 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:42.865610 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:42.866473 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 11:52:42.866473 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 11:52:42.866473 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:52:42.866473 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:52:42.868298 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 260/538] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:52:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:42.874606 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac074e-0d4f-496c-b554-c0ecb1b279e8 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:42.936155 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca42f1-039f-47c5-9b07-f04d52bb49c0 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:42.975445 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfafa86-6f1e-410c-bf5b-7c18eed7038c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:42.976185 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfafa86-6f1e-410c-bf5b-7c18eed7038c None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:42.976466 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfafa86-6f1e-410c-bf5b-7c18eed7038c None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:42.976740 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfafa86-6f1e-410c-bf5b-7c18eed7038c None admin] PATH_INFO: `/v3/roles/service` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:42.987053 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac074e-0d4f-496c-b554-c0ecb1b279e8 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:42.988108 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfafa86-6f1e-410c-bf5b-7c18eed7038c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:52:42.997756 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-6bfafa86-6f1e-410c-bf5b-7c18eed7038c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 11:52:42.997756 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:42.997756 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:42.997756 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:42.997756 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:42.997756 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:42.997756 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:42.997756 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:42.997756 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:42.997756 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:42.997756 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:42.997756 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:42.997756 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:52:42.997756 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:52:42.997756 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:52:42.997756 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:52:42.998646 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:52:42.998646 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:52:42.998646 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:52:42.998646 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:52:42.998646 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:42.998646 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:42.998646 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:42.998646 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:42.998646 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:42.998646 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:42.998646 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:42.998646 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:52:42.998646 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:42.998646 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:42.998646 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:42.998646 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:42.999433 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:42.999433 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:42.999433 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:42.999433 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:42.999433 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:52:42.999433 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:52:42.999433 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:52:42.999433 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:52:42.999433 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:52:42.999433 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:52:42.999433 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 11:52:42.999433 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:52:43.000762 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 279/539] 10.222.0.44 () {56 vars in 1102 bytes} [Wed May 25 11:52:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 11:52:43.000946 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec1c01-d98e-4c11-b06f-890b2caa2a16 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:43.001191 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec1c01-d98e-4c11-b06f-890b2caa2a16 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:43.001474 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec1c01-d98e-4c11-b06f-890b2caa2a16 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:43.002883 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 280/540] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:52:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:52:43.004754 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec1c01-d98e-4c11-b06f-890b2caa2a16 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:43.020169 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:43.031916 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0e159c-129f-47bb-bd3a-9ef378a580cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:43.032583 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e159c-129f-47bb-bd3a-9ef378a580cf None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:43.032870 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e159c-129f-47bb-bd3a-9ef378a580cf None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:43.033164 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e159c-129f-47bb-bd3a-9ef378a580cf None admin] PATH_INFO: `/v3/domains` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:43.033872 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0e159c-129f-47bb-bd3a-9ef378a580cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:43.034178 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0e159c-129f-47bb-bd3a-9ef378a580cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:43.035554 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0e159c-129f-47bb-bd3a-9ef378a580cf None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:43.047097 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 261/541] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 25 11:52:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:43.048318 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8173f9-0321-4715-a5d6-c29c47fa5d92 None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:43.048612 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8173f9-0321-4715-a5d6-c29c47fa5d92 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:43.048889 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8173f9-0321-4715-a5d6-c29c47fa5d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:43.064661 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-fb8173f9-0321-4715-a5d6-c29c47fa5d92 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:52:43.065834 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-fb8173f9-0321-4715-a5d6-c29c47fa5d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:52:43.094993 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:43.124993 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec1c01-d98e-4c11-b06f-890b2caa2a16 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:43.143815 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 262/542] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:52:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 11:52:43.143815 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8173f9-0321-4715-a5d6-c29c47fa5d92 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:43.183846 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4185a68-8790-4f41-bf6b-14a7bc7fdd27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:43.183846 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4185a68-8790-4f41-bf6b-14a7bc7fdd27 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:43.183846 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4185a68-8790-4f41-bf6b-14a7bc7fdd27 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:43.183846 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4185a68-8790-4f41-bf6b-14a7bc7fdd27 None admin] PATH_INFO: `/v3/roles` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:43.184751 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4185a68-8790-4f41-bf6b-14a7bc7fdd27 None admin] RBAC: Adding query filter params (name=service) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:43.184751 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4185a68-8790-4f41-bf6b-14a7bc7fdd27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:43.184751 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4185a68-8790-4f41-bf6b-14a7bc7fdd27 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:43.192639 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 281/543] 10.222.0.44 () {56 vars in 1103 bytes} [Wed May 25 11:52:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:52:43.193469 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4185a68-8790-4f41-bf6b-14a7bc7fdd27 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:43.254649 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8173f9-0321-4715-a5d6-c29c47fa5d92 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:43.270320 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:43.293471 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d22de7-4852-4580-aca9-f6cf564c5eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:43.294258 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d22de7-4852-4580-aca9-f6cf564c5eec None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:43.294541 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d22de7-4852-4580-aca9-f6cf564c5eec None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:43.294816 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d22de7-4852-4580-aca9-f6cf564c5eec None admin] PATH_INFO: `/v3/users/nova` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:43.298486 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4185a68-8790-4f41-bf6b-14a7bc7fdd27 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:43.302388 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d22de7-4852-4580-aca9-f6cf564c5eec None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:43.303844 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d22de7-4852-4580-aca9-f6cf564c5eec None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:43.323117 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-58d22de7-4852-4580-aca9-f6cf564c5eec None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 11:52:43.323117 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:43.323117 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:43.323117 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:43.323117 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:43.323117 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:43.323117 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:43.323117 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:43.323117 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:43.323117 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:43.323117 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:43.323117 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:43.323117 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 11:52:43.323117 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 11:52:43.323117 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 11:52:43.323117 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 11:52:43.324188 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:43.324188 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:43.324188 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 11:52:43.324188 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 11:52:43.324188 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 11:52:43.324188 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 11:52:43.324188 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:43.324188 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:43.324188 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:43.324188 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:43.324188 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:43.324188 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:52:43.324188 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:43.324188 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:43.324188 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:43.324188 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:43.324188 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:43.324188 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:43.325071 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:43.325071 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:43.325071 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 11:52:43.325071 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 11:52:43.325071 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 11:52:43.325071 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 11:52:43.325071 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 11:52:43.325071 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 11:52:43.325071 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 11:52:43.325071 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:52:43.326611 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 263/544] 10.222.0.44 () {56 vars in 1093 bytes} [Wed May 25 11:52:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:43.327476 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d22de7-4852-4580-aca9-f6cf564c5eec None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:43.342849 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6cfb3-2c19-4c01-ba85-90a8f8e9ca01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:43.343652 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6cfb3-2c19-4c01-ba85-90a8f8e9ca01 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:43.343961 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6cfb3-2c19-4c01-ba85-90a8f8e9ca01 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:43.344225 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6cfb3-2c19-4c01-ba85-90a8f8e9ca01 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:43.346785 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:43.355213 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e6cfb3-2c19-4c01-ba85-90a8f8e9ca01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:52:43.362905 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-64e6cfb3-2c19-4c01-ba85-90a8f8e9ca01 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 11:52:43.362905 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:43.362905 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:43.362905 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:43.362905 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:43.362905 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:43.362905 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:43.362905 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:43.362905 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:43.362905 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:43.362905 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:43.362905 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:43.362905 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:52:43.362905 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:52:43.362905 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:52:43.362905 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:52:43.363838 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:52:43.363838 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:52:43.363838 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:52:43.363838 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:52:43.363838 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:43.363838 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:43.363838 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:43.363838 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:43.363838 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:43.363838 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:43.363838 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:43.363838 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:52:43.363838 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:43.363838 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:43.363838 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:43.363838 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:43.364665 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:43.364665 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:43.364665 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:43.364665 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:43.364665 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:52:43.364665 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:52:43.364665 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:52:43.364665 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:52:43.364665 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:52:43.364665 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:52:43.364665 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 11:52:43.364665 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:52:43.364665 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 282/545] 10.222.0.44 () {56 vars in 1102 bytes} [Wed May 25 11:52:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:43.365325 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1c078-3cd4-43de-be0e-65511662c1f6 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:43.366188 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1c078-3cd4-43de-be0e-65511662c1f6 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:43.366188 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1c078-3cd4-43de-be0e-65511662c1f6 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:43.370876 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 283/546] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:52:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:52:43.370876 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c1c078-3cd4-43de-be0e-65511662c1f6 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:43.438491 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d22de7-4852-4580-aca9-f6cf564c5eec None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:43.468349 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c1c078-3cd4-43de-be0e-65511662c1f6 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:43.470854 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2914590-2e22-4cd9-bce9-e049966cbaa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:43.471647 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2914590-2e22-4cd9-bce9-e049966cbaa4 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:43.471963 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2914590-2e22-4cd9-bce9-e049966cbaa4 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:43.472243 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2914590-2e22-4cd9-bce9-e049966cbaa4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:43.482772 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2914590-2e22-4cd9-bce9-e049966cbaa4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:43.484254 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2914590-2e22-4cd9-bce9-e049966cbaa4 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:43.500968 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415eb92d-3476-4218-9842-c541e47b3a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:43.501580 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-f2914590-2e22-4cd9-bce9-e049966cbaa4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:52:43.501580 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:43.501580 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:43.501580 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:43.501580 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:43.501580 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:43.501580 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:43.501580 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:43.501580 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:43.501580 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:43.501580 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:43.501580 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:43.501580 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 11:52:43.501580 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 11:52:43.501580 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 11:52:43.502448 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 11:52:43.502448 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:43.502448 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:43.502448 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:43.502448 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:43.502448 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:43.502448 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:43.502448 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:43.502448 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:52:43.502448 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:43.502448 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:43.502448 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:43.502448 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:43.502448 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:43.502448 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:43.502448 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:43.502448 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:43.503299 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 11:52:43.503299 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 11:52:43.503299 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:52:43.503299 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:52:43.503508 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415eb92d-3476-4218-9842-c541e47b3a19 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:43.503508 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415eb92d-3476-4218-9842-c541e47b3a19 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:43.503508 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415eb92d-3476-4218-9842-c541e47b3a19 None admin] PATH_INFO: `/v3/users` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:43.503690 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 264/547] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:52:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:43.503755 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415eb92d-3476-4218-9842-c541e47b3a19 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:43.503755 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415eb92d-3476-4218-9842-c541e47b3a19 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:43.503934 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2914590-2e22-4cd9-bce9-e049966cbaa4 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:43.504762 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415eb92d-3476-4218-9842-c541e47b3a19 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:43.523526 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 284/548] 10.222.0.44 () {56 vars in 1133 bytes} [Wed May 25 11:52:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:43.524784 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50cac0-4f40-461b-8522-e0bb2a268637 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:43.525094 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50cac0-4f40-461b-8522-e0bb2a268637 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:43.525383 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50cac0-4f40-461b-8522-e0bb2a268637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:43.534361 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:43.540937 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-8d50cac0-4f40-461b-8522-e0bb2a268637 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:52:43.542124 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-8d50cac0-4f40-461b-8522-e0bb2a268637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:52:43.589970 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:43.604941 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2914590-2e22-4cd9-bce9-e049966cbaa4 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:43.607259 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 285/549] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:52:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 11:52:43.608379 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d50cac0-4f40-461b-8522-e0bb2a268637 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:43.643096 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896bf11-808b-40c4-9e4f-5469b3e85411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:43.643774 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896bf11-808b-40c4-9e4f-5469b3e85411 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:43.644094 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896bf11-808b-40c4-9e4f-5469b3e85411 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:43.644374 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896bf11-808b-40c4-9e4f-5469b3e85411 None admin] PATH_INFO: `/v3/roles` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:43.645118 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896bf11-808b-40c4-9e4f-5469b3e85411 None admin] RBAC: Adding query filter params (name=service) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:43.645427 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896bf11-808b-40c4-9e4f-5469b3e85411 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:43.647057 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896bf11-808b-40c4-9e4f-5469b3e85411 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:43.659531 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 265/550] 10.222.0.44 () {56 vars in 1103 bytes} [Wed May 25 11:52:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:43.660403 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896bf11-808b-40c4-9e4f-5469b3e85411 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:43.723295 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d50cac0-4f40-461b-8522-e0bb2a268637 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:43.753108 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:43.757040 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32370104-6668-48b4-8977-92ba03d1d6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:43.757644 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32370104-6668-48b4-8977-92ba03d1d6d8 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:43.757926 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32370104-6668-48b4-8977-92ba03d1d6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:43.758245 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32370104-6668-48b4-8977-92ba03d1d6d8 None admin] PATH_INFO: `/v3/domains` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:43.758919 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32370104-6668-48b4-8977-92ba03d1d6d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:43.759228 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32370104-6668-48b4-8977-92ba03d1d6d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:43.760669 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32370104-6668-48b4-8977-92ba03d1d6d8 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:43.765838 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896bf11-808b-40c4-9e4f-5469b3e85411 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:43.771870 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 286/551] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 25 11:52:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:43.772673 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32370104-6668-48b4-8977-92ba03d1d6d8 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:43.800103 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642bf56a-baff-4237-bbe9-d5c592c3dfca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:43.800904 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642bf56a-baff-4237-bbe9-d5c592c3dfca None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:43.801189 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642bf56a-baff-4237-bbe9-d5c592c3dfca None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:43.801470 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642bf56a-baff-4237-bbe9-d5c592c3dfca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:43.811842 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642bf56a-baff-4237-bbe9-d5c592c3dfca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:43.813281 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642bf56a-baff-4237-bbe9-d5c592c3dfca None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:43.819743 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:43.831631 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-642bf56a-baff-4237-bbe9-d5c592c3dfca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:52:43.831631 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:43.831631 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:43.831631 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:43.831631 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:43.831631 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:43.831631 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:43.831631 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:43.831631 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:43.831631 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:43.831631 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:43.831631 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:43.831631 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 11:52:43.831631 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 11:52:43.831631 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 11:52:43.832621 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 11:52:43.832621 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:43.832621 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:43.832621 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:43.832621 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:43.832621 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:43.832621 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:43.832621 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:43.832621 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:52:43.832621 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:43.832621 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:43.832621 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:43.832621 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:43.832621 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:43.832621 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:43.832621 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:43.832621 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:43.833969 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 11:52:43.833969 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 11:52:43.833969 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:52:43.833969 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:52:43.833969 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 266/552] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:52:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:43.833969 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642bf56a-baff-4237-bbe9-d5c592c3dfca None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:43.881569 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32370104-6668-48b4-8977-92ba03d1d6d8 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:43.915287 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c448889d-7f94-4b51-8d21-2dcff9b3050f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:43.916125 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448889d-7f94-4b51-8d21-2dcff9b3050f None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:43.916404 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448889d-7f94-4b51-8d21-2dcff9b3050f None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:43.916682 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448889d-7f94-4b51-8d21-2dcff9b3050f None admin] PATH_INFO: `/v3/roles/service` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:43.926866 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c448889d-7f94-4b51-8d21-2dcff9b3050f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:52:43.934756 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-c448889d-7f94-4b51-8d21-2dcff9b3050f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 11:52:43.934756 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:43.934756 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:43.934756 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:43.934756 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:43.934756 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:43.934756 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:43.934756 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:43.934756 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:43.934756 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:43.934756 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:43.934756 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:43.934756 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:52:43.934756 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:52:43.934756 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:52:43.934756 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:52:43.936037 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:52:43.936037 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:52:43.936037 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:52:43.936037 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:52:43.936037 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:43.936037 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:43.936037 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:43.936037 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:43.936037 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:43.936037 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:43.936037 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:43.936037 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:52:43.936037 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:43.936037 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:43.936037 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:43.936037 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:43.937035 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:43.937035 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:43.937035 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:43.937035 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:43.937035 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:52:43.937035 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:52:43.937035 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:52:43.937035 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:52:43.937035 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:52:43.937035 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:52:43.937035 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 11:52:43.937035 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:52:43.937035 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 287/553] 10.222.0.44 () {56 vars in 1102 bytes} [Wed May 25 11:52:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:43.937035 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c448889d-7f94-4b51-8d21-2dcff9b3050f None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:43.943725 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642bf56a-baff-4237-bbe9-d5c592c3dfca None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:43.978094 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb75565-503c-4669-9d8a-a7bb4baf846d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:43.978995 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb75565-503c-4669-9d8a-a7bb4baf846d None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:43.979283 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb75565-503c-4669-9d8a-a7bb4baf846d None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:43.979562 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb75565-503c-4669-9d8a-a7bb4baf846d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:43.988427 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:43.991131 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb75565-503c-4669-9d8a-a7bb4baf846d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:43.993331 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb75565-503c-4669-9d8a-a7bb4baf846d None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:44.010872 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-3eb75565-503c-4669-9d8a-a7bb4baf846d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:52:44.010872 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:44.010872 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:44.010872 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:44.010872 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:44.010872 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:44.010872 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:44.010872 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:44.010872 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:44.010872 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:44.010872 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:44.010872 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:44.010872 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 11:52:44.010872 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 11:52:44.010872 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 11:52:44.012191 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 11:52:44.012191 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:44.012191 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:44.012191 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:44.012191 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:44.012191 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:44.012191 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:44.012191 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:44.012191 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:52:44.012191 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:44.012191 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:44.012191 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:44.012191 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:44.012191 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:44.012191 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:44.012191 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:44.012191 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:44.013235 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 11:52:44.013235 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 11:52:44.013235 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:52:44.013235 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:52:44.013235 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 267/554] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:52:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:44.013235 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb75565-503c-4669-9d8a-a7bb4baf846d None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:44.054016 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c448889d-7f94-4b51-8d21-2dcff9b3050f None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:44.056701 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:44.088617 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed78cc-b9df-4dc2-bdce-777726da1ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:44.089413 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed78cc-b9df-4dc2-bdce-777726da1ecb None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:44.089697 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed78cc-b9df-4dc2-bdce-777726da1ecb None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:44.089974 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed78cc-b9df-4dc2-bdce-777726da1ecb None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:44.097477 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed78cc-b9df-4dc2-bdce-777726da1ecb None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:44.098905 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed78cc-b9df-4dc2-bdce-777726da1ecb None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:44.112778 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-e3ed78cc-b9df-4dc2-bdce-777726da1ecb None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 25 11:52:44.112778 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:44.112778 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:44.112778 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:44.112778 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:44.112778 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:44.112778 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:44.112778 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:44.112778 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:44.112778 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:44.112778 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:44.112778 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:44.112778 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 11:52:44.112778 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 11:52:44.112778 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 11:52:44.112778 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 11:52:44.113894 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:44.113894 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:44.113894 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 11:52:44.113894 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 11:52:44.113894 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 11:52:44.113894 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 11:52:44.113894 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:44.113894 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:44.113894 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:44.113894 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:44.113894 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:44.113894 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:52:44.113894 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:44.113894 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:44.113894 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:44.113894 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:44.113894 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:44.113894 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:44.114926 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:44.114926 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:44.114926 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 11:52:44.114926 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 11:52:44.114926 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 11:52:44.114926 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 11:52:44.114926 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 11:52:44.114926 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 11:52:44.114926 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 25 11:52:44.114926 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:52:44.115464 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb75565-503c-4669-9d8a-a7bb4baf846d None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:44.115548 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 288/555] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 25 11:52:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:44.115548 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed78cc-b9df-4dc2-bdce-777726da1ecb None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:44.147814 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c0e7b-a9c0-4bca-93c9-5191fa95f767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:44.148497 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c0e7b-a9c0-4bca-93c9-5191fa95f767 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:44.148783 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c0e7b-a9c0-4bca-93c9-5191fa95f767 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:44.149061 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c0e7b-a9c0-4bca-93c9-5191fa95f767 None admin] PATH_INFO: `/v3/domains` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:44.149781 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726c0e7b-a9c0-4bca-93c9-5191fa95f767 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:44.150095 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726c0e7b-a9c0-4bca-93c9-5191fa95f767 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:44.152062 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726c0e7b-a9c0-4bca-93c9-5191fa95f767 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:44.163377 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 268/556] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 25 11:52:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:44.164210 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c0e7b-a9c0-4bca-93c9-5191fa95f767 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:44.216599 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:44.221644 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed78cc-b9df-4dc2-bdce-777726da1ecb None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:44.256067 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1dfbc0-d026-45db-9417-81306a92c025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:44.256735 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1dfbc0-d026-45db-9417-81306a92c025 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:44.257018 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1dfbc0-d026-45db-9417-81306a92c025 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:44.257297 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1dfbc0-d026-45db-9417-81306a92c025 None admin] PATH_INFO: `/v3/roles` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:44.258040 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1dfbc0-d026-45db-9417-81306a92c025 None admin] RBAC: Adding query filter params (name=service) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:44.258353 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1dfbc0-d026-45db-9417-81306a92c025 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:44.259744 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1dfbc0-d026-45db-9417-81306a92c025 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:44.262579 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c0e7b-a9c0-4bca-93c9-5191fa95f767 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:44.267751 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 289/557] 10.222.0.44 () {56 vars in 1103 bytes} [Wed May 25 11:52:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:44.268850 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1dfbc0-d026-45db-9417-81306a92c025 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:44.297153 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:44.301569 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f74b5a-0d4c-4c3c-8eb9-05490cf41c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:44.302239 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f74b5a-0d4c-4c3c-8eb9-05490cf41c96 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:44.302526 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f74b5a-0d4c-4c3c-8eb9-05490cf41c96 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:44.302806 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f74b5a-0d4c-4c3c-8eb9-05490cf41c96 None admin] PATH_INFO: `/v3/domains` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:44.303528 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f74b5a-0d4c-4c3c-8eb9-05490cf41c96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:44.303865 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f74b5a-0d4c-4c3c-8eb9-05490cf41c96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:44.305244 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f74b5a-0d4c-4c3c-8eb9-05490cf41c96 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:44.316401 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 269/558] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 25 11:52:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:44.317191 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f74b5a-0d4c-4c3c-8eb9-05490cf41c96 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:44.371014 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1dfbc0-d026-45db-9417-81306a92c025 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:44.403530 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e886b-d50d-4fd4-907c-32b5f2df7f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:44.404216 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e886b-d50d-4fd4-907c-32b5f2df7f26 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:44.404502 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e886b-d50d-4fd4-907c-32b5f2df7f26 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:44.404786 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e886b-d50d-4fd4-907c-32b5f2df7f26 None admin] PATH_INFO: `/v3/users` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:44.405612 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8e886b-d50d-4fd4-907c-32b5f2df7f26 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:44.405924 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8e886b-d50d-4fd4-907c-32b5f2df7f26 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:44.407345 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8e886b-d50d-4fd4-907c-32b5f2df7f26 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:44.416944 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f74b5a-0d4c-4c3c-8eb9-05490cf41c96 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:44.424490 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 290/559] 10.222.0.44 () {56 vars in 1137 bytes} [Wed May 25 11:52:44 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:44.425280 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e886b-d50d-4fd4-907c-32b5f2df7f26 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:44.433207 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:44.453987 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9031239-c8a7-4592-89f0-bfbe5b20466b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:44.454774 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9031239-c8a7-4592-89f0-bfbe5b20466b None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:44.455050 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9031239-c8a7-4592-89f0-bfbe5b20466b None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:44.455331 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9031239-c8a7-4592-89f0-bfbe5b20466b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:44.461916 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9031239-c8a7-4592-89f0-bfbe5b20466b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:44.463983 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9031239-c8a7-4592-89f0-bfbe5b20466b None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:44.480980 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-d9031239-c8a7-4592-89f0-bfbe5b20466b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 11:52:44.480980 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:44.480980 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:44.480980 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:44.480980 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:44.480980 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:44.480980 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:44.480980 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:44.480980 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:44.480980 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:44.480980 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:44.480980 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:44.480980 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 11:52:44.480980 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 11:52:44.480980 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 11:52:44.481942 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 11:52:44.481942 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:44.481942 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:44.481942 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:44.481942 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:44.481942 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:44.481942 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:44.481942 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:44.481942 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:52:44.481942 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:44.481942 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:44.481942 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:44.481942 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:44.481942 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:44.481942 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:44.481942 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:44.481942 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:44.482840 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 11:52:44.482840 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 11:52:44.482840 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 11:52:44.482840 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 11:52:44.482840 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 11:52:44.482840 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 11:52:44.482840 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 11:52:44.482840 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:52:44.482840 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 270/560] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 25 11:52:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:44.483318 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9031239-c8a7-4592-89f0-bfbe5b20466b None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:44.510465 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:44.527091 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e886b-d50d-4fd4-907c-32b5f2df7f26 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:44.561225 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9956b6-20df-48a5-b5d2-a4db071b6ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:44.562008 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9956b6-20df-48a5-b5d2-a4db071b6ed9 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:44.562297 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9956b6-20df-48a5-b5d2-a4db071b6ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:44.562578 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9956b6-20df-48a5-b5d2-a4db071b6ed9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:44.573443 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9956b6-20df-48a5-b5d2-a4db071b6ed9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:44.574914 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9956b6-20df-48a5-b5d2-a4db071b6ed9 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:44.578000 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9031239-c8a7-4592-89f0-bfbe5b20466b None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:44.592163 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-3d9956b6-20df-48a5-b5d2-a4db071b6ed9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:52:44.592163 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:44.592163 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:44.592163 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:44.592163 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:44.592163 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:44.592163 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:44.592163 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:44.592163 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:44.592163 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:44.592163 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:44.592163 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:44.592163 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 11:52:44.592163 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 11:52:44.592163 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 11:52:44.593196 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 11:52:44.593196 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:44.593196 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:44.593196 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:44.593196 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:44.593196 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:44.593196 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:44.593196 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:44.593196 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:52:44.593196 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:44.593196 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:44.593196 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:44.593196 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:44.593196 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:44.593196 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:44.593196 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:44.593196 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:44.594122 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 11:52:44.594122 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 11:52:44.594122 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:52:44.594122 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:52:44.594122 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 291/561] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:52:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:44.594401 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9956b6-20df-48a5-b5d2-a4db071b6ed9 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:44.613664 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10d4b6-e7d6-4085-a368-c56426c049d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:44.614462 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10d4b6-e7d6-4085-a368-c56426c049d9 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:44.614746 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10d4b6-e7d6-4085-a368-c56426c049d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:44.615021 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10d4b6-e7d6-4085-a368-c56426c049d9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:44.622563 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad10d4b6-e7d6-4085-a368-c56426c049d9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:44.624026 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad10d4b6-e7d6-4085-a368-c56426c049d9 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:44.638236 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-ad10d4b6-e7d6-4085-a368-c56426c049d9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 25 11:52:44.638236 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:44.638236 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:44.638236 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:44.638236 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:44.638236 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:44.638236 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:44.638236 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:44.638236 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:44.638236 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:44.638236 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:44.638236 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:44.638236 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 11:52:44.638236 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 11:52:44.638236 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 11:52:44.638236 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 11:52:44.639365 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:44.639365 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:44.639365 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 11:52:44.639365 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 11:52:44.639365 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 11:52:44.639365 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 11:52:44.639365 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:44.639365 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:44.639365 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:44.639365 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:44.639365 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:44.639365 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:52:44.639365 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:44.639365 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:44.639365 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:44.639365 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:44.639365 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:44.639365 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:44.640676 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:44.640676 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:44.640676 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 11:52:44.640676 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 11:52:44.640676 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 11:52:44.640676 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 11:52:44.640676 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 11:52:44.640676 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 11:52:44.640676 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 25 11:52:44.640676 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:52:44.640676 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 271/562] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 25 11:52:44 2022] GET /identity/v3/users/glance => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:44.640676 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10d4b6-e7d6-4085-a368-c56426c049d9 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:44.670740 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:44.700813 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9956b6-20df-48a5-b5d2-a4db071b6ed9 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:44.734313 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34bcbc6-ff1f-4aa2-ac0e-8a07ef442c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:44.735093 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bcbc6-ff1f-4aa2-ac0e-8a07ef442c62 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:44.735380 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bcbc6-ff1f-4aa2-ac0e-8a07ef442c62 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:44.735654 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bcbc6-ff1f-4aa2-ac0e-8a07ef442c62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:44.737448 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10d4b6-e7d6-4085-a368-c56426c049d9 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:44.738294 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:44.747537 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34bcbc6-ff1f-4aa2-ac0e-8a07ef442c62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:44.749009 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34bcbc6-ff1f-4aa2-ac0e-8a07ef442c62 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:44.767041 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-c34bcbc6-ff1f-4aa2-ac0e-8a07ef442c62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:52:44.767041 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:44.767041 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:44.767041 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:44.767041 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:44.767041 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:44.767041 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:44.767041 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:44.767041 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:44.767041 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:44.767041 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:44.767041 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:44.767041 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 11:52:44.767041 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 11:52:44.767041 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 11:52:44.768172 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 11:52:44.768172 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:44.768172 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:44.768172 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:44.768172 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:44.768172 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:44.768172 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:44.768172 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:44.768172 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:52:44.768172 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:44.768172 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:44.768172 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:44.768172 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:44.768172 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:44.768172 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:44.768172 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:44.768172 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:44.770148 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 11:52:44.770148 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 11:52:44.770148 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:52:44.770148 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:52:44.770148 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 292/563] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:52:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:44.770148 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34bcbc6-ff1f-4aa2-ac0e-8a07ef442c62 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:44.773695 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1f2fa4-d574-480e-a171-899cf160423f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:44.774362 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f2fa4-d574-480e-a171-899cf160423f None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:44.774648 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f2fa4-d574-480e-a171-899cf160423f None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:44.774923 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f2fa4-d574-480e-a171-899cf160423f None admin] PATH_INFO: `/v3/projects` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:44.775749 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1f2fa4-d574-480e-a171-899cf160423f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:44.776088 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1f2fa4-d574-480e-a171-899cf160423f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:44.777589 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1f2fa4-d574-480e-a171-899cf160423f None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:44.789272 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 272/564] 10.222.0.44 () {56 vars in 1148 bytes} [Wed May 25 11:52:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:44.790068 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1f2fa4-d574-480e-a171-899cf160423f None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:44.868893 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34bcbc6-ff1f-4aa2-ac0e-8a07ef442c62 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:44.880860 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:44.889713 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1f2fa4-d574-480e-a171-899cf160423f None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:44.907072 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c794d52-a063-4427-9299-c8c5e03acc49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:44.907072 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c794d52-a063-4427-9299-c8c5e03acc49 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:44.907072 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c794d52-a063-4427-9299-c8c5e03acc49 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:44.907072 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c794d52-a063-4427-9299-c8c5e03acc49 None admin] PATH_INFO: `/v3/domains` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:44.907501 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c794d52-a063-4427-9299-c8c5e03acc49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:44.907501 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c794d52-a063-4427-9299-c8c5e03acc49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:44.908649 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c794d52-a063-4427-9299-c8c5e03acc49 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:44.920719 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 293/565] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 25 11:52:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:44.921509 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c794d52-a063-4427-9299-c8c5e03acc49 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:44.924091 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e387dd-9182-4b23-8f18-fc38a13ad2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:44.924761 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e387dd-9182-4b23-8f18-fc38a13ad2ec None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:44.925042 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e387dd-9182-4b23-8f18-fc38a13ad2ec None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:44.925317 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e387dd-9182-4b23-8f18-fc38a13ad2ec None admin] PATH_INFO: `/v3/users` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:44.926149 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e387dd-9182-4b23-8f18-fc38a13ad2ec None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:44.926456 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e387dd-9182-4b23-8f18-fc38a13ad2ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:44.927893 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e387dd-9182-4b23-8f18-fc38a13ad2ec None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:44.945478 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 273/566] 10.222.0.44 () {56 vars in 1137 bytes} [Wed May 25 11:52:44 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:44.946236 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e387dd-9182-4b23-8f18-fc38a13ad2ec None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:44.969723 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:45.019285 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c794d52-a063-4427-9299-c8c5e03acc49 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:45.044859 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e387dd-9182-4b23-8f18-fc38a13ad2ec None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:45.054488 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102db97-2703-4083-a412-dbd8eb829300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:45.055155 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102db97-2703-4083-a412-dbd8eb829300 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:45.055437 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102db97-2703-4083-a412-dbd8eb829300 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:45.055715 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102db97-2703-4083-a412-dbd8eb829300 None admin] PATH_INFO: `/v3/domains` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:45.056507 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f102db97-2703-4083-a412-dbd8eb829300 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:45.056797 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f102db97-2703-4083-a412-dbd8eb829300 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:45.058201 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f102db97-2703-4083-a412-dbd8eb829300 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:45.069739 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 294/567] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 25 11:52:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:45.070531 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102db97-2703-4083-a412-dbd8eb829300 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:45.078560 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38118883-6205-4b21-b58b-72e5a526497e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:45.079450 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38118883-6205-4b21-b58b-72e5a526497e None admin] REQUEST_METHOD: `PUT` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:45.079739 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38118883-6205-4b21-b58b-72e5a526497e None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:45.080058 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38118883-6205-4b21-b58b-72e5a526497e None admin] PATH_INFO: `/v3/projects/57e08d47948142978437098a8120be78/users/d25d7a439361492d8d7ba018531a2e7a/roles/33fd4a41fa554c6699a6c832f8eb793e` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:45.095666 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38118883-6205-4b21-b58b-72e5a526497e None admin] RBAC: Authorizing `identity:create_grant(project_id=57e08d47948142978437098a8120be78, user_id=d25d7a439361492d8d7ba018531a2e7a, role_id=33fd4a41fa554c6699a6c832f8eb793e)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:45.097139 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38118883-6205-4b21-b58b-72e5a526497e None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:45.106721 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:45.112017 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 274/568] 10.222.0.44 () {58 vars in 1439 bytes} [Wed May 25 11:52:44 2022] PUT /identity/v3/projects/57e08d47948142978437098a8120be78/users/d25d7a439361492d8d7ba018531a2e7a/roles/33fd4a41fa554c6699a6c832f8eb793e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 11:52:45.113092 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38118883-6205-4b21-b58b-72e5a526497e None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:45.194262 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102db97-2703-4083-a412-dbd8eb829300 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:45.204855 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:45.235247 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ffc0e1-b0b8-4a10-a856-06cbac7ceb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:45.236370 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ffc0e1-b0b8-4a10-a856-06cbac7ceb2c None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:45.236662 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ffc0e1-b0b8-4a10-a856-06cbac7ceb2c None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:45.236939 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ffc0e1-b0b8-4a10-a856-06cbac7ceb2c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:45.237606 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38118883-6205-4b21-b58b-72e5a526497e None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:45.246827 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ffc0e1-b0b8-4a10-a856-06cbac7ceb2c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:45.248625 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ffc0e1-b0b8-4a10-a856-06cbac7ceb2c None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:45.265469 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-a8ffc0e1-b0b8-4a10-a856-06cbac7ceb2c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 25 11:52:45.265469 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:45.265469 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:45.265469 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:45.265469 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:45.265469 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:45.265469 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:45.265469 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:45.265469 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:45.265469 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:45.265469 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:45.265469 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:45.265469 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 11:52:45.265469 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 11:52:45.265469 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 11:52:45.265469 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 11:52:45.266496 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:45.266496 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:45.266496 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 11:52:45.266496 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 11:52:45.266496 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 11:52:45.266496 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 11:52:45.266496 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:45.266496 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:45.266496 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:45.266496 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:45.266496 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:45.266496 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:52:45.266496 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:45.266496 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:45.266496 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:45.266496 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:45.266496 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:45.266496 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:45.267436 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:45.267436 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:45.267436 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 11:52:45.267436 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 11:52:45.267436 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 11:52:45.267436 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 11:52:45.267436 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 11:52:45.267436 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 11:52:45.267436 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 25 11:52:45.267436 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:52:45.267436 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 295/569] 10.222.0.44 () {56 vars in 1102 bytes} [Wed May 25 11:52:45 2022] GET /identity/v3/users/neutron => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:45.268060 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ffc0e1-b0b8-4a10-a856-06cbac7ceb2c None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:45.278956 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a55adf0-b8eb-47d9-bce8-0cfa12541691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:45.279775 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55adf0-b8eb-47d9-bce8-0cfa12541691 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:45.280093 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55adf0-b8eb-47d9-bce8-0cfa12541691 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:45.280371 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55adf0-b8eb-47d9-bce8-0cfa12541691 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:45.297349 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a55adf0-b8eb-47d9-bce8-0cfa12541691 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:45.299072 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a55adf0-b8eb-47d9-bce8-0cfa12541691 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:45.318323 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-1a55adf0-b8eb-47d9-bce8-0cfa12541691 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:52:45.318323 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:45.318323 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:45.318323 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:45.318323 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:45.318323 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:45.318323 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:45.318323 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:45.318323 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:45.318323 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:45.318323 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:45.318323 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:45.318323 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 11:52:45.318323 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 11:52:45.318323 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 11:52:45.319337 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 11:52:45.319337 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:45.319337 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:45.319337 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:45.319337 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:45.319337 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:45.319337 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:45.319337 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:45.319337 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:52:45.319337 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:45.319337 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:45.319337 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:45.319337 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:45.319337 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:45.319337 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:45.319337 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:45.319337 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:45.320388 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 11:52:45.320388 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 11:52:45.320388 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:52:45.320388 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:52:45.320388 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 275/570] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:52:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:45.321136 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a55adf0-b8eb-47d9-bce8-0cfa12541691 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:45.375413 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:45.385261 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ffc0e1-b0b8-4a10-a856-06cbac7ceb2c None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:45.422999 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ea9e6-d6cb-4247-bb73-30999dca3036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:45.423818 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ea9e6-d6cb-4247-bb73-30999dca3036 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:45.424107 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ea9e6-d6cb-4247-bb73-30999dca3036 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:45.424393 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ea9e6-d6cb-4247-bb73-30999dca3036 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:45.428357 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a55adf0-b8eb-47d9-bce8-0cfa12541691 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:45.431359 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934ea9e6-d6cb-4247-bb73-30999dca3036 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:45.432874 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934ea9e6-d6cb-4247-bb73-30999dca3036 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:45.446713 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-934ea9e6-d6cb-4247-bb73-30999dca3036 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 11:52:45.446713 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:45.446713 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:45.446713 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:45.446713 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:45.446713 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:45.446713 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:45.446713 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:45.446713 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:45.446713 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:45.446713 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:45.446713 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:45.446713 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 11:52:45.446713 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 11:52:45.446713 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 11:52:45.448187 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 11:52:45.448187 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:45.448187 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:45.448187 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:45.448187 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:45.448187 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:45.448187 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:45.448187 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:45.448187 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:52:45.448187 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:45.448187 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:45.448187 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:45.448187 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:45.448187 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:45.448187 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:45.448187 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:45.448187 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:45.449097 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 11:52:45.449097 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 11:52:45.449097 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 11:52:45.449097 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 11:52:45.449097 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 11:52:45.449097 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 11:52:45.449097 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 11:52:45.449097 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:52:45.449097 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 296/571] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 25 11:52:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:45.449609 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ea9e6-d6cb-4247-bb73-30999dca3036 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:45.469519 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd8250e-b874-4c0e-bb9e-80c847ed72aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:45.470209 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8250e-b874-4c0e-bb9e-80c847ed72aa None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:45.470600 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8250e-b874-4c0e-bb9e-80c847ed72aa None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:45.470883 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8250e-b874-4c0e-bb9e-80c847ed72aa None admin] PATH_INFO: `/v3/users` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:45.471891 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd8250e-b874-4c0e-bb9e-80c847ed72aa None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:45.472188 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd8250e-b874-4c0e-bb9e-80c847ed72aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:45.473622 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd8250e-b874-4c0e-bb9e-80c847ed72aa None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:45.481184 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:45.493227 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 276/572] 10.222.0.44 () {56 vars in 1139 bytes} [Wed May 25 11:52:45 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:45.494158 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd8250e-b874-4c0e-bb9e-80c847ed72aa None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:45.560606 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ea9e6-d6cb-4247-bb73-30999dca3036 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:45.595882 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f41343b-3308-4dc2-ada4-80dd4218c46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:45.596636 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41343b-3308-4dc2-ada4-80dd4218c46a None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:45.596973 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41343b-3308-4dc2-ada4-80dd4218c46a None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:45.597310 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41343b-3308-4dc2-ada4-80dd4218c46a None admin] PATH_INFO: `/v3/domains` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:45.598091 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f41343b-3308-4dc2-ada4-80dd4218c46a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:45.598487 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f41343b-3308-4dc2-ada4-80dd4218c46a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:45.599964 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f41343b-3308-4dc2-ada4-80dd4218c46a None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:45.601417 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd8250e-b874-4c0e-bb9e-80c847ed72aa None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:45.612999 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:45.616187 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 297/573] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 25 11:52:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:45.617664 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f41343b-3308-4dc2-ada4-80dd4218c46a None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:45.639937 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb71b604-3645-4bec-86c1-bf7b08f4767c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:45.640855 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71b604-3645-4bec-86c1-bf7b08f4767c None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:45.641297 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71b604-3645-4bec-86c1-bf7b08f4767c None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:45.641731 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71b604-3645-4bec-86c1-bf7b08f4767c None admin] PATH_INFO: `/v3/projects` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:45.642668 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb71b604-3645-4bec-86c1-bf7b08f4767c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:45.643153 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb71b604-3645-4bec-86c1-bf7b08f4767c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:45.644600 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb71b604-3645-4bec-86c1-bf7b08f4767c None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:45.657704 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 277/574] 10.222.0.44 () {56 vars in 1148 bytes} [Wed May 25 11:52:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:45.658540 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb71b604-3645-4bec-86c1-bf7b08f4767c None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:45.718604 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:45.733026 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f41343b-3308-4dc2-ada4-80dd4218c46a None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:45.768412 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead1369-dc83-4e5a-925a-ffc16092b47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:45.769206 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead1369-dc83-4e5a-925a-ffc16092b47f None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:45.769493 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead1369-dc83-4e5a-925a-ffc16092b47f None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:45.769772 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead1369-dc83-4e5a-925a-ffc16092b47f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:45.773764 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb71b604-3645-4bec-86c1-bf7b08f4767c None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:45.781124 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aead1369-dc83-4e5a-925a-ffc16092b47f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:45.782612 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aead1369-dc83-4e5a-925a-ffc16092b47f None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:45.800960 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-aead1369-dc83-4e5a-925a-ffc16092b47f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:52:45.800960 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:45.800960 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:45.800960 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:45.800960 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:45.800960 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:45.800960 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:45.800960 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:45.800960 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:45.800960 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:45.800960 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:45.800960 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:45.800960 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 11:52:45.800960 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 11:52:45.800960 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 11:52:45.802056 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 11:52:45.802056 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:45.802056 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:45.802056 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:45.802056 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:45.802056 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:45.802056 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:45.802056 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:45.802056 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:52:45.802056 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:45.802056 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:45.802056 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:45.802056 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:45.802056 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:45.802056 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:45.802056 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:45.802056 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:45.803151 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 11:52:45.803151 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 11:52:45.803151 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:52:45.803151 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:52:45.808511 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 298/575] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:52:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:45.808511 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead1369-dc83-4e5a-925a-ffc16092b47f None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:45.818440 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495cbfb1-c32d-46aa-ab40-66a72bdb84d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:45.819330 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495cbfb1-c32d-46aa-ab40-66a72bdb84d6 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:45.819622 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495cbfb1-c32d-46aa-ab40-66a72bdb84d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:45.819936 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495cbfb1-c32d-46aa-ab40-66a72bdb84d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:45.826856 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495cbfb1-c32d-46aa-ab40-66a72bdb84d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:45.828385 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495cbfb1-c32d-46aa-ab40-66a72bdb84d6 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:45.843706 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-495cbfb1-c32d-46aa-ab40-66a72bdb84d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 11:52:45.843706 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:45.843706 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:45.843706 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:45.843706 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:45.843706 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:45.843706 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:45.843706 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:45.843706 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:45.843706 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:45.843706 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:45.843706 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:45.843706 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 11:52:45.843706 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 11:52:45.843706 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 11:52:45.844856 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 11:52:45.844856 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:45.844856 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:45.844856 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:45.844856 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:45.844856 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:45.844856 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:45.844856 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:45.844856 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:52:45.844856 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:45.844856 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:45.844856 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:45.844856 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:45.844856 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:45.844856 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:45.844856 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:45.844856 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:45.845923 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 11:52:45.845923 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 11:52:45.845923 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 11:52:45.845923 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 11:52:45.845923 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 11:52:45.845923 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 11:52:45.845923 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 11:52:45.845923 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:52:45.845923 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 278/576] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 25 11:52:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:45.846421 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495cbfb1-c32d-46aa-ab40-66a72bdb84d6 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:45.881066 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:45.926869 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead1369-dc83-4e5a-925a-ffc16092b47f None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:45.963742 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac5ce3-3287-455c-b6b6-583ab7a01332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:45.964653 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac5ce3-3287-455c-b6b6-583ab7a01332 None admin] REQUEST_METHOD: `PUT` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:45.964943 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac5ce3-3287-455c-b6b6-583ab7a01332 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:45.965218 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac5ce3-3287-455c-b6b6-583ab7a01332 None admin] PATH_INFO: `/v3/projects/57e08d47948142978437098a8120be78/users/9c940de37d2d453c875d3ab6c077a331/roles/33fd4a41fa554c6699a6c832f8eb793e` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:45.965558 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495cbfb1-c32d-46aa-ab40-66a72bdb84d6 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:45.976589 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:45.981903 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aac5ce3-3287-455c-b6b6-583ab7a01332 None admin] RBAC: Authorizing `identity:create_grant(project_id=57e08d47948142978437098a8120be78, user_id=9c940de37d2d453c875d3ab6c077a331, role_id=33fd4a41fa554c6699a6c832f8eb793e)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:45.983989 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aac5ce3-3287-455c-b6b6-583ab7a01332 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:45.998072 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 299/577] 10.222.0.44 () {58 vars in 1439 bytes} [Wed May 25 11:52:45 2022] PUT /identity/v3/projects/57e08d47948142978437098a8120be78/users/9c940de37d2d453c875d3ab6c077a331/roles/33fd4a41fa554c6699a6c832f8eb793e => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 11:52:45.998862 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac5ce3-3287-455c-b6b6-583ab7a01332 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:46.008826 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccdc050-ecdf-4807-9056-a2846e0c63a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:46.010003 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccdc050-ecdf-4807-9056-a2846e0c63a9 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:46.011068 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccdc050-ecdf-4807-9056-a2846e0c63a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:46.011611 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccdc050-ecdf-4807-9056-a2846e0c63a9 None admin] PATH_INFO: `/v3/domains` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:46.013477 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccdc050-ecdf-4807-9056-a2846e0c63a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:46.014086 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccdc050-ecdf-4807-9056-a2846e0c63a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:46.016690 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccdc050-ecdf-4807-9056-a2846e0c63a9 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:46.040710 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 279/578] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 25 11:52:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:46.045188 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccdc050-ecdf-4807-9056-a2846e0c63a9 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:46.128791 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac5ce3-3287-455c-b6b6-583ab7a01332 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:46.174099 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33bcbb5-9fe7-4263-bf16-63ce0d2c6efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:46.174888 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33bcbb5-9fe7-4263-bf16-63ce0d2c6efc None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:46.175249 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33bcbb5-9fe7-4263-bf16-63ce0d2c6efc None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:46.175597 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33bcbb5-9fe7-4263-bf16-63ce0d2c6efc None admin] PATH_INFO: `/v3/projects` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:46.176491 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33bcbb5-9fe7-4263-bf16-63ce0d2c6efc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:46.180541 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33bcbb5-9fe7-4263-bf16-63ce0d2c6efc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:46.182131 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33bcbb5-9fe7-4263-bf16-63ce0d2c6efc None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:46.184032 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:46.195397 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 300/579] 10.222.0.44 () {56 vars in 1148 bytes} [Wed May 25 11:52:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:46.198940 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccdc050-ecdf-4807-9056-a2846e0c63a9 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:46.202446 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33bcbb5-9fe7-4263-bf16-63ce0d2c6efc None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:46.239100 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83f952f-da3d-4586-8476-0049379d10f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:46.239965 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f952f-da3d-4586-8476-0049379d10f8 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:46.240260 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f952f-da3d-4586-8476-0049379d10f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:46.240541 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f952f-da3d-4586-8476-0049379d10f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:46.247920 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83f952f-da3d-4586-8476-0049379d10f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:46.249388 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83f952f-da3d-4586-8476-0049379d10f8 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:46.264330 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-a83f952f-da3d-4586-8476-0049379d10f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 11:52:46.264330 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:46.264330 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:46.264330 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:46.264330 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:46.264330 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:46.264330 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:46.264330 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:46.264330 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:46.264330 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:46.264330 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:46.264330 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:46.264330 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 11:52:46.264330 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 11:52:46.264330 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 11:52:46.265442 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 11:52:46.265442 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:46.265442 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:46.265442 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:46.265442 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:46.265442 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:46.265442 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:46.265442 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:46.265442 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:52:46.265442 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:46.265442 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:46.265442 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:46.265442 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:46.265442 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:46.265442 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:46.265442 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:46.265442 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:46.266631 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 11:52:46.266631 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 11:52:46.266631 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 11:52:46.266631 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 11:52:46.266631 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 11:52:46.266631 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 11:52:46.266631 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 11:52:46.266631 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:52:46.270378 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 280/580] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 25 11:52:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:46.271855 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83f952f-da3d-4586-8476-0049379d10f8 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:46.276236 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:46.321785 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33bcbb5-9fe7-4263-bf16-63ce0d2c6efc None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:46.358951 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693edb1e-cd06-4a98-959a-49dadcbd7c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:46.360371 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693edb1e-cd06-4a98-959a-49dadcbd7c3f None admin] REQUEST_METHOD: `PUT` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:46.361134 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693edb1e-cd06-4a98-959a-49dadcbd7c3f None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:46.361624 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693edb1e-cd06-4a98-959a-49dadcbd7c3f None admin] PATH_INFO: `/v3/projects/57e08d47948142978437098a8120be78/users/bda1409f24a24f51b42043933e30a560/roles/33fd4a41fa554c6699a6c832f8eb793e` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:46.377468 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83f952f-da3d-4586-8476-0049379d10f8 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:46.378596 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693edb1e-cd06-4a98-959a-49dadcbd7c3f None admin] RBAC: Authorizing `identity:create_grant(project_id=57e08d47948142978437098a8120be78, user_id=bda1409f24a24f51b42043933e30a560, role_id=33fd4a41fa554c6699a6c832f8eb793e)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:46.380930 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693edb1e-cd06-4a98-959a-49dadcbd7c3f None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:46.404024 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 301/581] 10.222.0.44 () {58 vars in 1439 bytes} [Wed May 25 11:52:46 2022] PUT /identity/v3/projects/57e08d47948142978437098a8120be78/users/bda1409f24a24f51b42043933e30a560/roles/33fd4a41fa554c6699a6c832f8eb793e => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 11:52:46.416400 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bbd156-4c6b-40d8-9492-3d38033b99df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:46.417224 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbd156-4c6b-40d8-9492-3d38033b99df None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:46.417515 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbd156-4c6b-40d8-9492-3d38033b99df None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:46.417795 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbd156-4c6b-40d8-9492-3d38033b99df None admin] PATH_INFO: `/v3/projects` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:46.418602 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bbd156-4c6b-40d8-9492-3d38033b99df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:46.418916 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bbd156-4c6b-40d8-9492-3d38033b99df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:46.420449 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bbd156-4c6b-40d8-9492-3d38033b99df None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:46.439484 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 281/582] 10.222.0.44 () {56 vars in 1148 bytes} [Wed May 25 11:52:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:46.441000 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693edb1e-cd06-4a98-959a-49dadcbd7c3f None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:46.552703 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:46.555903 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693edb1e-cd06-4a98-959a-49dadcbd7c3f None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:46.598369 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1619ae76-c88d-4239-937f-68bfda66ccf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:46.599325 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619ae76-c88d-4239-937f-68bfda66ccf7 None admin] REQUEST_METHOD: `PUT` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:46.599663 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619ae76-c88d-4239-937f-68bfda66ccf7 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:46.599970 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619ae76-c88d-4239-937f-68bfda66ccf7 None admin] PATH_INFO: `/v3/projects/57e08d47948142978437098a8120be78/users/be63af25271b49b5903e8fe66a62b1d2/roles/33fd4a41fa554c6699a6c832f8eb793e` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:46.616157 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1619ae76-c88d-4239-937f-68bfda66ccf7 None admin] RBAC: Authorizing `identity:create_grant(project_id=57e08d47948142978437098a8120be78, user_id=be63af25271b49b5903e8fe66a62b1d2, role_id=33fd4a41fa554c6699a6c832f8eb793e)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:46.617655 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1619ae76-c88d-4239-937f-68bfda66ccf7 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:46.634684 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 302/583] 10.222.0.44 () {58 vars in 1439 bytes} [Wed May 25 11:52:46 2022] PUT /identity/v3/projects/57e08d47948142978437098a8120be78/users/be63af25271b49b5903e8fe66a62b1d2/roles/33fd4a41fa554c6699a6c832f8eb793e => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 11:52:47.397213 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a8d2d-5662-4bad-b520-975120d1e315 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:47.397748 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a8d2d-5662-4bad-b520-975120d1e315 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:47.397748 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a8d2d-5662-4bad-b520-975120d1e315 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:47.399333 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 282/584] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:52:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:52:47.404680 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d11a71-c3f0-47d4-88a3-43af17dccf23 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:47.405086 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d11a71-c3f0-47d4-88a3-43af17dccf23 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:47.405266 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d11a71-c3f0-47d4-88a3-43af17dccf23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:47.421831 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-09d11a71-c3f0-47d4-88a3-43af17dccf23 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:52:47.423012 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-09d11a71-c3f0-47d4-88a3-43af17dccf23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:52:47.490798 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 303/585] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:52:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 11:52:47.516873 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a8d2d-5662-4bad-b520-975120d1e315 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:47.529963 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:47.629716 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a8d2d-5662-4bad-b520-975120d1e315 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:47.664679 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b66bc80-9d63-4c95-9c1f-74e9d225d00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:47.665479 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66bc80-9d63-4c95-9c1f-74e9d225d00d None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:47.666299 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66bc80-9d63-4c95-9c1f-74e9d225d00d None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:47.666578 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66bc80-9d63-4c95-9c1f-74e9d225d00d None admin] PATH_INFO: `/v3/roles/service` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:47.677149 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b66bc80-9d63-4c95-9c1f-74e9d225d00d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:52:47.689361 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-6b66bc80-9d63-4c95-9c1f-74e9d225d00d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 11:52:47.689361 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:47.689361 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:47.689361 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:47.689361 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:47.689361 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:47.689361 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:47.689361 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:47.689361 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:47.689361 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:47.689361 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:47.689361 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:47.689361 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:52:47.689361 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:52:47.689361 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:52:47.689361 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:52:47.690387 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:52:47.690387 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:52:47.690387 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:52:47.690387 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:52:47.690387 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:47.690387 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:47.690387 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:47.690387 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:47.690387 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:47.690387 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:47.690387 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:47.690387 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:52:47.690387 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:47.690387 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:47.690387 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:47.690387 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:47.691252 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:47.691252 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:47.691252 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:47.691252 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:47.691252 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:52:47.691252 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:52:47.691252 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:52:47.691252 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:52:47.691252 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:52:47.691252 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:52:47.691252 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 11:52:47.691252 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:52:47.691252 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 283/586] 10.222.0.44 () {56 vars in 1102 bytes} [Wed May 25 11:52:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:47.696771 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d11a71-c3f0-47d4-88a3-43af17dccf23 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:47.783666 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:47.810881 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d11a71-c3f0-47d4-88a3-43af17dccf23 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:47.849728 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54ac05-3935-4a21-81f9-00685ef568af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:47.850401 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54ac05-3935-4a21-81f9-00685ef568af None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:47.850684 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54ac05-3935-4a21-81f9-00685ef568af None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:47.850963 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54ac05-3935-4a21-81f9-00685ef568af None admin] PATH_INFO: `/v3/roles` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:47.851715 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d54ac05-3935-4a21-81f9-00685ef568af None admin] RBAC: Adding query filter params (name=service) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:47.852057 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d54ac05-3935-4a21-81f9-00685ef568af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:47.853989 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d54ac05-3935-4a21-81f9-00685ef568af None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:47.862551 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 304/587] 10.222.0.44 () {56 vars in 1103 bytes} [Wed May 25 11:52:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:47.867685 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b66bc80-9d63-4c95-9c1f-74e9d225d00d None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:47.939678 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:47.971411 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b66bc80-9d63-4c95-9c1f-74e9d225d00d None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:48.005717 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3c1425-afac-436b-8bd6-d0629f028f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:48.006519 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c1425-afac-436b-8bd6-d0629f028f9e None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:48.006807 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c1425-afac-436b-8bd6-d0629f028f9e None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:48.007088 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3c1425-afac-436b-8bd6-d0629f028f9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:48.018267 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3c1425-afac-436b-8bd6-d0629f028f9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:48.019718 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3c1425-afac-436b-8bd6-d0629f028f9e None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:48.037832 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-fe3c1425-afac-436b-8bd6-d0629f028f9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:52:48.037832 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:48.037832 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:48.037832 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:48.037832 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:48.037832 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:48.037832 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:48.037832 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:48.037832 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:48.037832 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:48.037832 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:48.037832 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:48.037832 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 11:52:48.037832 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 11:52:48.037832 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 11:52:48.038741 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 11:52:48.038741 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:48.038741 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:48.038741 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:48.038741 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:48.038741 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:48.038741 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:48.038741 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:48.038741 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:52:48.038741 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:48.038741 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:48.038741 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:48.038741 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:48.038741 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:48.038741 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:48.038741 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:48.038741 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:48.039653 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 11:52:48.039653 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 11:52:48.039653 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:52:48.039653 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:52:48.039653 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 284/588] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:52:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:48.045408 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54ac05-3935-4a21-81f9-00685ef568af None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:48.148927 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54ac05-3935-4a21-81f9-00685ef568af None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:48.183637 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf8c81-946a-473f-9bd5-326177e1b64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:48.184334 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf8c81-946a-473f-9bd5-326177e1b64a None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:48.184615 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf8c81-946a-473f-9bd5-326177e1b64a None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:48.185342 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf8c81-946a-473f-9bd5-326177e1b64a None admin] PATH_INFO: `/v3/domains` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:48.187836 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadf8c81-946a-473f-9bd5-326177e1b64a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:48.187836 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadf8c81-946a-473f-9bd5-326177e1b64a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:48.187836 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadf8c81-946a-473f-9bd5-326177e1b64a None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:48.201240 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 305/589] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 25 11:52:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:48.206815 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3c1425-afac-436b-8bd6-d0629f028f9e None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:48.308810 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3c1425-afac-436b-8bd6-d0629f028f9e None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:48.348170 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:48.355706 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b1de8-ee70-427b-a4e1-8315240eea54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:48.356982 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b1de8-ee70-427b-a4e1-8315240eea54 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:48.357541 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b1de8-ee70-427b-a4e1-8315240eea54 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:48.358046 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b1de8-ee70-427b-a4e1-8315240eea54 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:48.366686 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348b1de8-ee70-427b-a4e1-8315240eea54 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:48.368441 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348b1de8-ee70-427b-a4e1-8315240eea54 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:48.382871 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-348b1de8-ee70-427b-a4e1-8315240eea54 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 11:52:48.382871 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:48.382871 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:48.382871 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:48.382871 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:48.382871 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:48.382871 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:48.382871 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:48.382871 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:48.382871 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:48.382871 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:48.382871 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:48.382871 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 11:52:48.382871 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 11:52:48.382871 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 11:52:48.382871 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 11:52:48.383906 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:48.383906 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:48.383906 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 11:52:48.383906 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 11:52:48.383906 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 11:52:48.383906 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 11:52:48.383906 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:48.383906 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:48.383906 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:48.383906 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:48.383906 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:48.383906 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:52:48.383906 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:48.383906 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:48.383906 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:48.383906 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:48.383906 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:48.383906 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:48.385427 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:48.385427 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:48.385427 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 11:52:48.385427 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 11:52:48.385427 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 11:52:48.385427 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 11:52:48.385427 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 11:52:48.385427 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 11:52:48.385427 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 11:52:48.385427 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:52:48.388126 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 285/590] 10.222.0.44 () {56 vars in 1093 bytes} [Wed May 25 11:52:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:48.399818 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf8c81-946a-473f-9bd5-326177e1b64a None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:48.399818 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:48.443241 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26a27e-45eb-4fd8-b8c9-dbe223fc045e None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:48.444246 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26a27e-45eb-4fd8-b8c9-dbe223fc045e None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:48.444717 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26a27e-45eb-4fd8-b8c9-dbe223fc045e None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:48.446298 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 286/591] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:52:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 11:52:48.452243 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43bc77-537a-4ec6-aad9-9d8dbd35e467 None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:48.452549 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43bc77-537a-4ec6-aad9-9d8dbd35e467 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:48.452825 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43bc77-537a-4ec6-aad9-9d8dbd35e467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:48.476457 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-3b43bc77-537a-4ec6-aad9-9d8dbd35e467 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:52:48.477673 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-3b43bc77-537a-4ec6-aad9-9d8dbd35e467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:52:48.509621 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf8c81-946a-473f-9bd5-326177e1b64a None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:48.553080 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c4d814-0748-4e0c-9773-25b0a90f3851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:48.554667 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4d814-0748-4e0c-9773-25b0a90f3851 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:48.555181 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4d814-0748-4e0c-9773-25b0a90f3851 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:48.555874 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4d814-0748-4e0c-9773-25b0a90f3851 None admin] PATH_INFO: `/v3/users` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:48.557981 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c4d814-0748-4e0c-9773-25b0a90f3851 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:48.558623 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c4d814-0748-4e0c-9773-25b0a90f3851 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:48.560803 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c4d814-0748-4e0c-9773-25b0a90f3851 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:48.571906 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 287/592] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:52:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 11:52:48.585311 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 306/593] 10.222.0.44 () {56 vars in 1133 bytes} [Wed May 25 11:52:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:48.593033 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b43bc77-537a-4ec6-aad9-9d8dbd35e467 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:48.597935 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c4d814-0748-4e0c-9773-25b0a90f3851 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:48.682395 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:48.711563 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b43bc77-537a-4ec6-aad9-9d8dbd35e467 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:48.727316 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:48.738187 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c4d814-0748-4e0c-9773-25b0a90f3851 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:48.758447 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c6cee-3ef9-4227-aa8c-24b8d7f332ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:48.759106 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c6cee-3ef9-4227-aa8c-24b8d7f332ac None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:48.759467 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c6cee-3ef9-4227-aa8c-24b8d7f332ac None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:48.759746 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c6cee-3ef9-4227-aa8c-24b8d7f332ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:48.777078 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c39a7-b37b-4b0c-b627-c2223eb05b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:48.778268 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c39a7-b37b-4b0c-b627-c2223eb05b4d None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:48.778759 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c39a7-b37b-4b0c-b627-c2223eb05b4d None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:48.779258 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c39a7-b37b-4b0c-b627-c2223eb05b4d None admin] PATH_INFO: `/v3/roles/service` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:48.791020 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8c39a7-b37b-4b0c-b627-c2223eb05b4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:52:48.799824 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-4d8c39a7-b37b-4b0c-b627-c2223eb05b4d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 11:52:48.799824 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:48.799824 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:48.799824 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:48.799824 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:48.799824 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:48.799824 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:48.799824 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:48.799824 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:48.799824 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:48.799824 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:48.799824 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:48.799824 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:52:48.799824 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:52:48.799824 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:52:48.799824 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:52:48.802369 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:52:48.802369 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:52:48.802369 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:52:48.802369 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:52:48.802369 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:48.802369 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:48.802369 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:48.802369 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:48.802369 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:48.802369 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:48.802369 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:48.802369 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:52:48.802369 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:48.802369 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:48.802369 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:48.802369 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:48.803234 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:48.803234 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:48.803234 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:48.803234 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:48.803234 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:52:48.803234 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:52:48.803234 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:52:48.803234 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:52:48.803234 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:52:48.803234 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:52:48.803234 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 11:52:48.803234 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:52:48.811304 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 307/594] 10.222.0.44 () {56 vars in 1102 bytes} [Wed May 25 11:52:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:48.813211 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c39a7-b37b-4b0c-b627-c2223eb05b4d None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:48.848530 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0c6cee-3ef9-4227-aa8c-24b8d7f332ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:48.849989 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0c6cee-3ef9-4227-aa8c-24b8d7f332ac None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:48.922238 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c39a7-b37b-4b0c-b627-c2223eb05b4d None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:48.943718 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:48.953177 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 288/595] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 25 11:52:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 11:52:48.954702 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15135b1-15f6-4ac9-9efe-8305f0fd4e6f None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:48.955021 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15135b1-15f6-4ac9-9efe-8305f0fd4e6f None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:48.955279 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15135b1-15f6-4ac9-9efe-8305f0fd4e6f None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:48.956724 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 289/596] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:52:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:52:48.958459 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15135b1-15f6-4ac9-9efe-8305f0fd4e6f None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:48.967042 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36270e43-5ed6-4fd5-a067-99ec274c0377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:48.967814 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36270e43-5ed6-4fd5-a067-99ec274c0377 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:48.968179 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36270e43-5ed6-4fd5-a067-99ec274c0377 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:48.968544 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36270e43-5ed6-4fd5-a067-99ec274c0377 None admin] PATH_INFO: `/v3/roles` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:48.969368 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36270e43-5ed6-4fd5-a067-99ec274c0377 None admin] RBAC: Adding query filter params (name=service) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:48.969753 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36270e43-5ed6-4fd5-a067-99ec274c0377 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:48.971138 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36270e43-5ed6-4fd5-a067-99ec274c0377 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:48.975779 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:48.980929 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 308/597] 10.222.0.44 () {56 vars in 1103 bytes} [Wed May 25 11:52:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:52:48.986514 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995279e-777c-4c4e-9f51-9dd56d14a1cb None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:48.986804 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995279e-777c-4c4e-9f51-9dd56d14a1cb None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:48.987086 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995279e-777c-4c4e-9f51-9dd56d14a1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:49.004481 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-5995279e-777c-4c4e-9f51-9dd56d14a1cb None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:52:49.005653 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-5995279e-777c-4c4e-9f51-9dd56d14a1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:52:49.064975 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15135b1-15f6-4ac9-9efe-8305f0fd4e6f None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:49.070245 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 309/598] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:52:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 11:52:49.071050 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5995279e-777c-4c4e-9f51-9dd56d14a1cb None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:49.107764 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f9bc3-0539-491d-8232-2faeebe3b991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:49.108584 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f9bc3-0539-491d-8232-2faeebe3b991 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:49.108864 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f9bc3-0539-491d-8232-2faeebe3b991 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:49.109137 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f9bc3-0539-491d-8232-2faeebe3b991 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:49.119330 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17f9bc3-0539-491d-8232-2faeebe3b991 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:49.120790 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17f9bc3-0539-491d-8232-2faeebe3b991 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:49.137757 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-a17f9bc3-0539-491d-8232-2faeebe3b991 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:52:49.137757 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:49.137757 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:49.137757 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:49.137757 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:49.137757 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:49.137757 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:49.137757 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:49.137757 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:49.137757 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:49.137757 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:49.137757 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:49.137757 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 11:52:49.137757 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 11:52:49.137757 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 11:52:49.138777 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 11:52:49.138777 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:49.138777 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:49.138777 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:49.138777 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:49.138777 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:49.138777 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:49.138777 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:49.138777 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:52:49.138777 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:49.138777 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:49.138777 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:49.138777 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:49.138777 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:49.138777 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:49.138777 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:49.138777 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:49.139721 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 11:52:49.139721 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 11:52:49.139721 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:52:49.139721 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:52:49.139721 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 290/599] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:52:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 11:52:49.140505 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6aa9a-c960-4084-ab3b-d8165e6f805f None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:49.140797 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6aa9a-c960-4084-ab3b-d8165e6f805f None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:49.141075 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6aa9a-c960-4084-ab3b-d8165e6f805f None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:49.142316 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 291/600] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:52:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:52:49.143007 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac6aa9a-c960-4084-ab3b-d8165e6f805f None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:49.176707 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5995279e-777c-4c4e-9f51-9dd56d14a1cb None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:49.191998 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:49.208465 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:49.212845 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5524609b-7887-4e5a-8486-f8c166dbdb80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:49.213655 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524609b-7887-4e5a-8486-f8c166dbdb80 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:49.213931 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524609b-7887-4e5a-8486-f8c166dbdb80 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:49.214197 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524609b-7887-4e5a-8486-f8c166dbdb80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:49.224301 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5524609b-7887-4e5a-8486-f8c166dbdb80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:49.225763 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5524609b-7887-4e5a-8486-f8c166dbdb80 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:49.243655 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-5524609b-7887-4e5a-8486-f8c166dbdb80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:52:49.243655 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:49.243655 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:49.243655 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:49.243655 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:49.243655 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:49.243655 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:49.243655 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:49.243655 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:49.243655 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:49.243655 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:49.243655 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:49.243655 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 11:52:49.243655 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 11:52:49.243655 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 11:52:49.244741 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 11:52:49.244741 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:49.244741 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:49.244741 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:49.244741 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:49.244741 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:49.244741 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:49.244741 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:49.244741 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:52:49.244741 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:49.244741 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:49.244741 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:49.244741 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:49.244741 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:49.244741 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:49.244741 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:49.244741 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:49.245634 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 11:52:49.245634 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 11:52:49.245634 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:52:49.245634 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:52:49.245634 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 310/601] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:52:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:49.245634 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5524609b-7887-4e5a-8486-f8c166dbdb80 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:49.250510 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac6aa9a-c960-4084-ab3b-d8165e6f805f None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:49.285595 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6f9ed-da19-4c9a-b96d-8a2e1ac8c7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:49.286393 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6f9ed-da19-4c9a-b96d-8a2e1ac8c7ee None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:49.286676 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6f9ed-da19-4c9a-b96d-8a2e1ac8c7ee None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:49.286961 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6f9ed-da19-4c9a-b96d-8a2e1ac8c7ee None admin] PATH_INFO: `/v3/roles/service` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:49.298091 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae6f9ed-da19-4c9a-b96d-8a2e1ac8c7ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:52:49.305871 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-2ae6f9ed-da19-4c9a-b96d-8a2e1ac8c7ee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 11:52:49.305871 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:49.305871 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:49.305871 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:49.305871 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:49.305871 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:49.305871 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:49.305871 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:49.305871 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:49.305871 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:49.305871 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:49.305871 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:49.305871 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:52:49.305871 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:52:49.305871 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:52:49.305871 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:52:49.306839 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:52:49.306839 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:52:49.306839 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:52:49.306839 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:52:49.306839 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:49.306839 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:49.306839 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:49.306839 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:49.306839 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:49.306839 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:49.306839 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:49.306839 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:52:49.306839 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:49.306839 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:49.306839 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:49.306839 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:49.308165 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:49.308165 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:49.308165 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:49.308165 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:49.308165 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:52:49.308165 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:52:49.308165 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:52:49.308165 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:52:49.308165 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:52:49.308165 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:52:49.308165 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 11:52:49.308165 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:52:49.308165 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 292/602] 10.222.0.44 () {56 vars in 1102 bytes} [Wed May 25 11:52:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:49.309043 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b7d92-2b9d-4bbe-8b60-29709273e78c None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:49.309043 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b7d92-2b9d-4bbe-8b60-29709273e78c None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:49.309043 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b7d92-2b9d-4bbe-8b60-29709273e78c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:49.326829 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-364b7d92-2b9d-4bbe-8b60-29709273e78c None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:52:49.327974 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-364b7d92-2b9d-4bbe-8b60-29709273e78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:52:49.346994 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5524609b-7887-4e5a-8486-f8c166dbdb80 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:49.379477 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ccc59-6795-4991-b7b5-bb9c23a0215a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:49.380165 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ccc59-6795-4991-b7b5-bb9c23a0215a None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:49.380464 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ccc59-6795-4991-b7b5-bb9c23a0215a None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:49.380723 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ccc59-6795-4991-b7b5-bb9c23a0215a None admin] PATH_INFO: `/v3/domains` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:49.381441 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47ccc59-6795-4991-b7b5-bb9c23a0215a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:49.381748 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47ccc59-6795-4991-b7b5-bb9c23a0215a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:49.383100 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47ccc59-6795-4991-b7b5-bb9c23a0215a None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:49.393672 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 293/603] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:52:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 11:52:49.394500 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b7d92-2b9d-4bbe-8b60-29709273e78c None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:49.394924 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 311/604] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 25 11:52:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:49.395616 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ccc59-6795-4991-b7b5-bb9c23a0215a None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:49.437262 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:49.451408 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:49.496258 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b7d92-2b9d-4bbe-8b60-29709273e78c None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:49.511969 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ccc59-6795-4991-b7b5-bb9c23a0215a None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:49.529900 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9db070-a9cc-4611-8b6f-81b561c7792e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:49.530557 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9db070-a9cc-4611-8b6f-81b561c7792e None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:49.530849 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9db070-a9cc-4611-8b6f-81b561c7792e None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:49.531130 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9db070-a9cc-4611-8b6f-81b561c7792e None admin] PATH_INFO: `/v3/domains` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:49.531871 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9db070-a9cc-4611-8b6f-81b561c7792e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:49.532188 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9db070-a9cc-4611-8b6f-81b561c7792e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:49.533649 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9db070-a9cc-4611-8b6f-81b561c7792e None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:49.544253 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a6574-9d17-421a-bcd7-39c72e066781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:49.544827 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 294/605] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 25 11:52:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:49.544946 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a6574-9d17-421a-bcd7-39c72e066781 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:49.545192 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a6574-9d17-421a-bcd7-39c72e066781 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:49.545493 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a6574-9d17-421a-bcd7-39c72e066781 None admin] PATH_INFO: `/v3/roles` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:49.545665 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9db070-a9cc-4611-8b6f-81b561c7792e None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:49.546216 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132a6574-9d17-421a-bcd7-39c72e066781 None admin] RBAC: Adding query filter params (name=service) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:49.546527 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132a6574-9d17-421a-bcd7-39c72e066781 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:49.547919 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132a6574-9d17-421a-bcd7-39c72e066781 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:49.556555 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 312/606] 10.222.0.44 () {56 vars in 1103 bytes} [Wed May 25 11:52:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:49.557198 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a6574-9d17-421a-bcd7-39c72e066781 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:49.640299 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:49.659006 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9db070-a9cc-4611-8b6f-81b561c7792e None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:49.659381 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a6574-9d17-421a-bcd7-39c72e066781 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:49.672507 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:49.693509 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128cf194-19c9-41a0-8533-fe33a8c539bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:49.694313 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128cf194-19c9-41a0-8533-fe33a8c539bc None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:49.694606 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128cf194-19c9-41a0-8533-fe33a8c539bc None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:49.694889 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128cf194-19c9-41a0-8533-fe33a8c539bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:49.705453 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128cf194-19c9-41a0-8533-fe33a8c539bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:49.706999 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128cf194-19c9-41a0-8533-fe33a8c539bc None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:49.712982 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c286affa-e43e-46ec-b2ba-5e828f175e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:49.714220 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286affa-e43e-46ec-b2ba-5e828f175e06 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:49.714627 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286affa-e43e-46ec-b2ba-5e828f175e06 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:49.715036 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286affa-e43e-46ec-b2ba-5e828f175e06 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:49.722181 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-128cf194-19c9-41a0-8533-fe33a8c539bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 11:52:49.722181 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:49.722181 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:49.722181 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:49.722181 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:49.722181 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:49.722181 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:49.722181 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:49.722181 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:49.722181 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:49.722181 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:49.722181 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:49.722181 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 11:52:49.722181 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 11:52:49.722181 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 11:52:49.723249 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 11:52:49.723249 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:49.723249 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:49.723249 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:49.723249 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:49.723249 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:49.723249 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:49.723249 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:49.723249 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:52:49.723249 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:49.723249 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:49.723249 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:49.723249 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:49.723249 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:49.723249 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:49.723249 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:49.723249 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:49.724435 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 11:52:49.724435 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 11:52:49.724435 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 11:52:49.724435 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 11:52:49.724435 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 11:52:49.724435 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 11:52:49.724435 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 11:52:49.724435 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:52:49.724435 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 295/607] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 25 11:52:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:49.724435 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128cf194-19c9-41a0-8533-fe33a8c539bc None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:49.729474 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c286affa-e43e-46ec-b2ba-5e828f175e06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:52:49.737347 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-c286affa-e43e-46ec-b2ba-5e828f175e06 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 11:52:49.737347 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:49.737347 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:49.737347 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:49.737347 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:49.737347 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:49.737347 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:49.737347 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:49.737347 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:49.737347 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:49.737347 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:49.737347 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:49.737347 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:52:49.737347 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:52:49.737347 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:52:49.737347 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:52:49.738290 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:52:49.738290 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:52:49.738290 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:52:49.738290 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:52:49.738290 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:49.738290 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:49.738290 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:49.738290 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:49.738290 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:49.738290 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:49.738290 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:49.738290 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:52:49.738290 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:49.738290 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:49.738290 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:49.738290 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:49.739140 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:49.739140 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:49.739140 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:49.739140 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:49.739140 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:52:49.739140 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:52:49.739140 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:52:49.739140 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:52:49.739140 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:52:49.739140 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:52:49.739140 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 11:52:49.739140 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:52:49.739140 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 313/608] 10.222.0.44 () {56 vars in 1102 bytes} [Wed May 25 11:52:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:49.740027 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c286affa-e43e-46ec-b2ba-5e828f175e06 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:49.826230 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128cf194-19c9-41a0-8533-fe33a8c539bc None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:49.841049 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c286affa-e43e-46ec-b2ba-5e828f175e06 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:49.860374 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96dbdd2-9b31-46d3-90bb-2fc02be6e245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:49.861181 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96dbdd2-9b31-46d3-90bb-2fc02be6e245 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:49.861471 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96dbdd2-9b31-46d3-90bb-2fc02be6e245 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:49.861746 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96dbdd2-9b31-46d3-90bb-2fc02be6e245 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:49.868830 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96dbdd2-9b31-46d3-90bb-2fc02be6e245 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:49.870275 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96dbdd2-9b31-46d3-90bb-2fc02be6e245 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:49.874944 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec067c9-ee97-419b-aef8-1dd9f86326c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:49.875734 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec067c9-ee97-419b-aef8-1dd9f86326c4 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:49.876047 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec067c9-ee97-419b-aef8-1dd9f86326c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:49.876324 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec067c9-ee97-419b-aef8-1dd9f86326c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:49.885343 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-a96dbdd2-9b31-46d3-90bb-2fc02be6e245 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 25 11:52:49.885343 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:49.885343 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:49.885343 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:49.885343 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:49.885343 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:49.885343 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:49.885343 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:49.885343 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:49.885343 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:49.885343 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:49.885343 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:49.885343 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 11:52:49.885343 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 11:52:49.885343 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 11:52:49.885343 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 11:52:49.886436 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:49.886436 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:49.886436 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 11:52:49.886436 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 11:52:49.886436 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 11:52:49.886436 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 11:52:49.886436 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:49.886436 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:49.886436 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:49.886436 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:49.886436 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:49.886436 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:52:49.886436 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:49.886436 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:49.886436 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:49.886436 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:49.886436 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:49.886436 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:49.887365 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:49.887365 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:49.887365 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 11:52:49.887365 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 11:52:49.887365 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 11:52:49.887365 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 11:52:49.887365 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 11:52:49.887365 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 11:52:49.887365 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 25 11:52:49.887365 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:52:49.887365 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 296/609] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 25 11:52:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:49.887365 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96dbdd2-9b31-46d3-90bb-2fc02be6e245 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:49.888057 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec067c9-ee97-419b-aef8-1dd9f86326c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:49.889285 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec067c9-ee97-419b-aef8-1dd9f86326c4 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:49.895778 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:49.909086 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-3ec067c9-ee97-419b-aef8-1dd9f86326c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:52:49.909086 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:49.909086 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:49.909086 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:49.909086 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:49.909086 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:49.909086 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:49.909086 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:49.909086 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:49.909086 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:49.909086 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:49.909086 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:49.909086 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 11:52:49.909086 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 11:52:49.909086 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 11:52:49.910157 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 11:52:49.910157 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:49.910157 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:49.910157 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:49.910157 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:49.910157 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:49.910157 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:49.910157 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:49.910157 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:52:49.910157 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:49.910157 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:49.910157 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:49.910157 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:49.910157 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:49.910157 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:49.910157 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:49.910157 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:49.911154 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 11:52:49.911154 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 11:52:49.911154 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:52:49.911154 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:52:49.911154 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 314/610] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:52:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:49.911427 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec067c9-ee97-419b-aef8-1dd9f86326c4 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:49.929614 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:49.994804 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96dbdd2-9b31-46d3-90bb-2fc02be6e245 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:50.034171 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72484346-2d87-4689-bda0-c18675f299a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:50.034862 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72484346-2d87-4689-bda0-c18675f299a6 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:50.035148 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72484346-2d87-4689-bda0-c18675f299a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:50.035431 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72484346-2d87-4689-bda0-c18675f299a6 None admin] PATH_INFO: `/v3/projects` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:50.036262 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72484346-2d87-4689-bda0-c18675f299a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:50.036577 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72484346-2d87-4689-bda0-c18675f299a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:50.038062 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72484346-2d87-4689-bda0-c18675f299a6 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:50.051011 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 297/611] 10.222.0.44 () {56 vars in 1148 bytes} [Wed May 25 11:52:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:50.052306 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72484346-2d87-4689-bda0-c18675f299a6 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:50.127260 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec067c9-ee97-419b-aef8-1dd9f86326c4 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:50.147604 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:50.155050 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72484346-2d87-4689-bda0-c18675f299a6 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:50.162371 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8008b139-2d25-400c-83cf-2bfd9d0b90db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:50.163031 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008b139-2d25-400c-83cf-2bfd9d0b90db None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:50.163315 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008b139-2d25-400c-83cf-2bfd9d0b90db None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:50.163593 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008b139-2d25-400c-83cf-2bfd9d0b90db None admin] PATH_INFO: `/v3/roles` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:50.164382 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8008b139-2d25-400c-83cf-2bfd9d0b90db None admin] RBAC: Adding query filter params (name=service) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:50.164697 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8008b139-2d25-400c-83cf-2bfd9d0b90db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:50.166099 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8008b139-2d25-400c-83cf-2bfd9d0b90db None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:50.174215 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 315/612] 10.222.0.44 () {56 vars in 1103 bytes} [Wed May 25 11:52:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:50.175043 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8008b139-2d25-400c-83cf-2bfd9d0b90db None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:50.193384 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b76be-06f8-4ac9-8fea-03dfed3dd9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:50.194063 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b76be-06f8-4ac9-8fea-03dfed3dd9c0 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:50.194349 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b76be-06f8-4ac9-8fea-03dfed3dd9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:50.194627 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b76be-06f8-4ac9-8fea-03dfed3dd9c0 None admin] PATH_INFO: `/v3/users` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:50.195461 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b76be-06f8-4ac9-8fea-03dfed3dd9c0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:50.195770 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b76be-06f8-4ac9-8fea-03dfed3dd9c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:50.197793 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b76be-06f8-4ac9-8fea-03dfed3dd9c0 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:50.215436 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 298/613] 10.222.0.44 () {56 vars in 1137 bytes} [Wed May 25 11:52:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:50.216396 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b76be-06f8-4ac9-8fea-03dfed3dd9c0 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:50.239524 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:50.279101 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8008b139-2d25-400c-83cf-2bfd9d0b90db None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:50.313168 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd2f2e-0eba-4a21-abf5-1eabbe22306d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:50.313825 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd2f2e-0eba-4a21-abf5-1eabbe22306d None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:50.314110 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd2f2e-0eba-4a21-abf5-1eabbe22306d None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:50.314384 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd2f2e-0eba-4a21-abf5-1eabbe22306d None admin] PATH_INFO: `/v3/domains` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:50.314594 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b76be-06f8-4ac9-8fea-03dfed3dd9c0 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:50.315100 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fd2f2e-0eba-4a21-abf5-1eabbe22306d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:50.315409 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fd2f2e-0eba-4a21-abf5-1eabbe22306d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:50.316811 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fd2f2e-0eba-4a21-abf5-1eabbe22306d None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:50.327694 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 316/614] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 25 11:52:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:50.328507 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd2f2e-0eba-4a21-abf5-1eabbe22306d None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:50.352096 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c48d2-3cce-45ad-92c1-a906e9e0470c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:50.352751 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c48d2-3cce-45ad-92c1-a906e9e0470c None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:50.353666 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c48d2-3cce-45ad-92c1-a906e9e0470c None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:50.353944 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c48d2-3cce-45ad-92c1-a906e9e0470c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:50.354760 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21c48d2-3cce-45ad-92c1-a906e9e0470c None admin] RBAC: Adding query filter params (role.id=33fd4a41fa554c6699a6c832f8eb793e, scope.project.id=57e08d47948142978437098a8120be78, user.id=d25d7a439361492d8d7ba018531a2e7a) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:50.355074 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21c48d2-3cce-45ad-92c1-a906e9e0470c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:50.356531 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21c48d2-3cce-45ad-92c1-a906e9e0470c None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:50.362440 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 299/615] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 25 11:52:50 2022] GET /identity/v3/role_assignments?user.id=d25d7a439361492d8d7ba018531a2e7a&scope.project.id=57e08d47948142978437098a8120be78&role.id=33fd4a41fa554c6699a6c832f8eb793e => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:50.376048 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c48d2-3cce-45ad-92c1-a906e9e0470c None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:50.383478 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:50.441784 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd2f2e-0eba-4a21-abf5-1eabbe22306d None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:50.466545 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:50.482725 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cef090-f8a0-4b4a-ad7b-dfe0bb6403e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:50.483556 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cef090-f8a0-4b4a-ad7b-dfe0bb6403e3 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:50.483832 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cef090-f8a0-4b4a-ad7b-dfe0bb6403e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:50.484110 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cef090-f8a0-4b4a-ad7b-dfe0bb6403e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:50.485070 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c48d2-3cce-45ad-92c1-a906e9e0470c None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:50.496024 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cef090-f8a0-4b4a-ad7b-dfe0bb6403e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:50.497506 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cef090-f8a0-4b4a-ad7b-dfe0bb6403e3 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:50.515699 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-08cef090-f8a0-4b4a-ad7b-dfe0bb6403e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:52:50.515699 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:50.515699 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:50.515699 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:50.515699 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:50.515699 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:50.515699 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:50.515699 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:50.515699 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:50.515699 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:50.515699 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:50.515699 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:50.515699 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 11:52:50.515699 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 11:52:50.515699 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 11:52:50.517200 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 11:52:50.517200 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:50.517200 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:50.517200 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:50.517200 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:50.517200 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:50.517200 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:50.517200 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:50.517200 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:52:50.517200 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:50.517200 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:50.517200 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:50.517200 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:50.517200 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:50.517200 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:50.517200 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:50.517200 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:50.518117 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 11:52:50.518117 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 11:52:50.518117 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:52:50.518117 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:52:50.518117 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 317/616] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:52:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:50.518117 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cef090-f8a0-4b4a-ad7b-dfe0bb6403e3 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:50.529882 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b49003-a1bc-4caa-9816-9be4a04456b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:50.530562 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b49003-a1bc-4caa-9816-9be4a04456b3 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:50.530851 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b49003-a1bc-4caa-9816-9be4a04456b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:50.531526 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b49003-a1bc-4caa-9816-9be4a04456b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:50.616386 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b49003-a1bc-4caa-9816-9be4a04456b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:50.617853 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b49003-a1bc-4caa-9816-9be4a04456b3 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:50.635565 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cef090-f8a0-4b4a-ad7b-dfe0bb6403e3 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:50.637546 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:50.671431 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c90507-545a-4843-a055-fd4cdf1c3403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:50.672257 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c90507-545a-4843-a055-fd4cdf1c3403 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:50.672537 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c90507-545a-4843-a055-fd4cdf1c3403 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:50.672809 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c90507-545a-4843-a055-fd4cdf1c3403 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:50.680497 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c90507-545a-4843-a055-fd4cdf1c3403 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:50.681975 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c90507-545a-4843-a055-fd4cdf1c3403 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:50.696471 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-a0c90507-545a-4843-a055-fd4cdf1c3403 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 25 11:52:50.696471 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:50.696471 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:50.696471 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:50.696471 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:50.696471 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:50.696471 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:50.696471 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:50.696471 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:50.696471 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:50.696471 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:50.696471 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:50.696471 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 11:52:50.696471 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 11:52:50.696471 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 11:52:50.696471 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 11:52:50.697959 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:50.697959 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:50.697959 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 11:52:50.697959 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 11:52:50.697959 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 11:52:50.697959 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 11:52:50.697959 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:50.697959 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:50.697959 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:50.697959 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:50.697959 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:50.697959 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:52:50.697959 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:50.697959 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:50.697959 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:50.697959 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:50.697959 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:50.697959 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:50.698961 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:50.698961 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:50.698961 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 11:52:50.698961 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 11:52:50.698961 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 11:52:50.698961 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 11:52:50.698961 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 11:52:50.698961 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 11:52:50.698961 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 25 11:52:50.698961 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:52:50.698961 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 318/617] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 25 11:52:50 2022] GET /identity/v3/users/glance => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:50.700250 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c90507-545a-4843-a055-fd4cdf1c3403 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:50.730364 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 300/618] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 25 11:52:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 11:52:50.731582 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b49003-a1bc-4caa-9816-9be4a04456b3 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:50.735214 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:50.806415 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c90507-545a-4843-a055-fd4cdf1c3403 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:50.844141 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b49003-a1bc-4caa-9816-9be4a04456b3 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:50.851001 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b16da11-391d-4e71-8494-85d8a903b0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:50.851669 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16da11-391d-4e71-8494-85d8a903b0ad None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:50.851986 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16da11-391d-4e71-8494-85d8a903b0ad None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:50.852261 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16da11-391d-4e71-8494-85d8a903b0ad None admin] PATH_INFO: `/v3/domains` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:50.853435 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b16da11-391d-4e71-8494-85d8a903b0ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:50.853755 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b16da11-391d-4e71-8494-85d8a903b0ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:50.855481 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b16da11-391d-4e71-8494-85d8a903b0ad None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:50.863023 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:50.872931 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 319/619] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 25 11:52:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:50.873738 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b16da11-391d-4e71-8494-85d8a903b0ad None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:50.883062 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7e2b9b-da75-4871-967e-dbbe44ef41f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:50.883741 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e2b9b-da75-4871-967e-dbbe44ef41f9 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:50.884054 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e2b9b-da75-4871-967e-dbbe44ef41f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:50.884863 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e2b9b-da75-4871-967e-dbbe44ef41f9 None admin] PATH_INFO: `/v3/users` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:50.885695 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7e2b9b-da75-4871-967e-dbbe44ef41f9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:50.886001 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7e2b9b-da75-4871-967e-dbbe44ef41f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:50.887422 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7e2b9b-da75-4871-967e-dbbe44ef41f9 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:50.911237 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 301/620] 10.222.0.44 () {56 vars in 1137 bytes} [Wed May 25 11:52:50 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:50.911237 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7e2b9b-da75-4871-967e-dbbe44ef41f9 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:50.977000 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:50.988513 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b16da11-391d-4e71-8494-85d8a903b0ad None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:51.013382 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7e2b9b-da75-4871-967e-dbbe44ef41f9 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:51.024376 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e16ab1-41db-4389-83ad-6f6e5da30e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:51.025691 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e16ab1-41db-4389-83ad-6f6e5da30e16 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:51.025971 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e16ab1-41db-4389-83ad-6f6e5da30e16 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:51.026247 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e16ab1-41db-4389-83ad-6f6e5da30e16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:51.036878 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e16ab1-41db-4389-83ad-6f6e5da30e16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:51.038322 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e16ab1-41db-4389-83ad-6f6e5da30e16 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:51.050214 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3408fa-205c-4a02-b78a-2c8fb57ec48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:51.051015 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3408fa-205c-4a02-b78a-2c8fb57ec48c None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:51.051300 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3408fa-205c-4a02-b78a-2c8fb57ec48c None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:51.051575 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3408fa-205c-4a02-b78a-2c8fb57ec48c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:51.056395 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-f8e16ab1-41db-4389-83ad-6f6e5da30e16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:52:51.056395 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:51.056395 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:51.056395 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:51.056395 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:51.056395 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:51.056395 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:51.056395 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:51.056395 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:51.056395 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:51.056395 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:51.056395 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:51.056395 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 11:52:51.056395 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 11:52:51.056395 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 11:52:51.057598 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 11:52:51.057598 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:51.057598 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:51.057598 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:51.057598 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:51.057598 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:51.057598 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:51.057598 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:51.057598 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:52:51.057598 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:51.057598 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:51.057598 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:51.057598 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:51.057598 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:51.057598 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:51.057598 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:51.057598 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:51.058706 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 11:52:51.058706 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 11:52:51.058706 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:52:51.058706 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:52:51.060199 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3408fa-205c-4a02-b78a-2c8fb57ec48c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:51.061769 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3408fa-205c-4a02-b78a-2c8fb57ec48c None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:51.062493 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 320/621] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:52:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:51.063018 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e16ab1-41db-4389-83ad-6f6e5da30e16 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:51.077457 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-cf3408fa-205c-4a02-b78a-2c8fb57ec48c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 25 11:52:51.077457 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:51.077457 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:51.077457 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:51.077457 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:51.077457 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:51.077457 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:51.077457 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:51.077457 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:51.077457 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:51.077457 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:51.077457 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:51.077457 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 11:52:51.077457 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 11:52:51.077457 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 11:52:51.077457 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 11:52:51.078662 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:51.078662 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:51.078662 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 11:52:51.078662 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 11:52:51.078662 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 11:52:51.078662 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 11:52:51.078662 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:51.078662 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:51.078662 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:51.078662 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:51.078662 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:51.078662 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:52:51.078662 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:51.078662 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:51.078662 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:51.078662 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:51.078662 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:51.078662 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:51.084891 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:51.084891 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:51.084891 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 11:52:51.084891 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 11:52:51.084891 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 11:52:51.084891 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 11:52:51.084891 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 11:52:51.084891 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 11:52:51.084891 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 25 11:52:51.084891 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:52:51.084891 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 302/622] 10.222.0.44 () {56 vars in 1102 bytes} [Wed May 25 11:52:50 2022] GET /identity/v3/users/neutron => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:51.084891 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3408fa-205c-4a02-b78a-2c8fb57ec48c None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:51.121807 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:51.177463 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e16ab1-41db-4389-83ad-6f6e5da30e16 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:51.196812 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3408fa-205c-4a02-b78a-2c8fb57ec48c None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:51.216517 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e45230d-b1da-46d5-a598-00d4dda60be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:51.217226 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45230d-b1da-46d5-a598-00d4dda60be6 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:51.217509 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45230d-b1da-46d5-a598-00d4dda60be6 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:51.217784 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45230d-b1da-46d5-a598-00d4dda60be6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:51.233378 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c04b9c1-ec10-432a-a071-500e82a372a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:51.234108 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04b9c1-ec10-432a-a071-500e82a372a6 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:51.234496 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04b9c1-ec10-432a-a071-500e82a372a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:51.234652 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:51.234945 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04b9c1-ec10-432a-a071-500e82a372a6 None admin] PATH_INFO: `/v3/domains` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:51.235758 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c04b9c1-ec10-432a-a071-500e82a372a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:51.236190 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c04b9c1-ec10-432a-a071-500e82a372a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:51.237665 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c04b9c1-ec10-432a-a071-500e82a372a6 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:51.249726 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 303/623] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 25 11:52:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:51.250532 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c04b9c1-ec10-432a-a071-500e82a372a6 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:51.297549 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e45230d-b1da-46d5-a598-00d4dda60be6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:51.299224 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e45230d-b1da-46d5-a598-00d4dda60be6 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:51.350030 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:51.358414 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c04b9c1-ec10-432a-a071-500e82a372a6 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:51.395866 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a8f398-5e53-4a87-bc6d-36a06818eb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:51.396923 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8f398-5e53-4a87-bc6d-36a06818eb5e None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:51.397294 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8f398-5e53-4a87-bc6d-36a06818eb5e None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:51.397685 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8f398-5e53-4a87-bc6d-36a06818eb5e None admin] PATH_INFO: `/v3/users` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:51.398695 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a8f398-5e53-4a87-bc6d-36a06818eb5e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:51.399106 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a8f398-5e53-4a87-bc6d-36a06818eb5e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:51.405197 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 321/624] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 25 11:52:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 11:52:51.405331 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a8f398-5e53-4a87-bc6d-36a06818eb5e None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:51.405422 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e45230d-b1da-46d5-a598-00d4dda60be6 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:51.422484 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 304/625] 10.222.0.44 () {56 vars in 1139 bytes} [Wed May 25 11:52:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:51.428087 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a8f398-5e53-4a87-bc6d-36a06818eb5e None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:51.456884 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:51.511564 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e45230d-b1da-46d5-a598-00d4dda60be6 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:51.537980 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a8f398-5e53-4a87-bc6d-36a06818eb5e None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:51.546504 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f865c8bd-423c-498d-b0a5-85af767f9640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:51.547300 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865c8bd-423c-498d-b0a5-85af767f9640 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:51.547574 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865c8bd-423c-498d-b0a5-85af767f9640 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:51.547874 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865c8bd-423c-498d-b0a5-85af767f9640 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:51.554688 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f865c8bd-423c-498d-b0a5-85af767f9640 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:51.556697 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f865c8bd-423c-498d-b0a5-85af767f9640 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:51.571041 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-f865c8bd-423c-498d-b0a5-85af767f9640 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 11:52:51.571041 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:51.571041 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:51.571041 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:51.571041 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:51.571041 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:51.571041 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:51.571041 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:51.571041 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:51.571041 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:51.571041 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:51.571041 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:51.571041 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 11:52:51.571041 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 11:52:51.571041 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 11:52:51.572056 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 11:52:51.572056 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:51.572056 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:51.572056 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:51.572056 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:51.572056 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:51.572056 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:51.572056 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:51.572056 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:52:51.572056 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:51.572056 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:51.572056 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:51.572056 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:51.572056 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:51.572056 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:51.572056 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:51.572056 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:51.573003 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 11:52:51.573003 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 11:52:51.573003 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 11:52:51.573003 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 11:52:51.573003 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 11:52:51.573003 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 11:52:51.573003 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 11:52:51.573003 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:52:51.573003 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 322/626] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 25 11:52:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:51.573935 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f865c8bd-423c-498d-b0a5-85af767f9640 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:51.580363 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa505e3b-3677-47ee-8f6b-38a863fed22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:51.581916 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa505e3b-3677-47ee-8f6b-38a863fed22b None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:51.581916 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa505e3b-3677-47ee-8f6b-38a863fed22b None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:51.581916 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa505e3b-3677-47ee-8f6b-38a863fed22b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:51.592199 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa505e3b-3677-47ee-8f6b-38a863fed22b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:51.593654 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa505e3b-3677-47ee-8f6b-38a863fed22b None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:51.612070 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-aa505e3b-3677-47ee-8f6b-38a863fed22b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:52:51.612070 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:51.612070 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:51.612070 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:51.612070 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:51.612070 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:51.612070 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:51.612070 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:51.612070 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:51.612070 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:51.612070 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:51.612070 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:51.612070 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 11:52:51.612070 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 11:52:51.612070 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 11:52:51.613044 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 11:52:51.613044 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:51.613044 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:51.613044 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:51.613044 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:51.613044 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:51.613044 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:51.613044 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:51.613044 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:52:51.613044 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:51.613044 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:51.613044 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:51.613044 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:51.613044 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:51.613044 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:51.613044 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:51.613044 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:51.613936 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 11:52:51.613936 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 11:52:51.613936 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:52:51.613936 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:52:51.613936 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 305/627] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:52:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:51.615511 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa505e3b-3677-47ee-8f6b-38a863fed22b None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:51.623491 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:51.680661 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f865c8bd-423c-498d-b0a5-85af767f9640 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:51.683462 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:51.723365 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b91af-457e-419f-8d20-c84e2003e015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:51.724212 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b91af-457e-419f-8d20-c84e2003e015 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:51.724451 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b91af-457e-419f-8d20-c84e2003e015 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:51.724726 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b91af-457e-419f-8d20-c84e2003e015 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:51.732013 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa505e3b-3677-47ee-8f6b-38a863fed22b None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:51.766486 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde1e96c-a908-4c50-bf10-2268868796aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:51.767067 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde1e96c-a908-4c50-bf10-2268868796aa None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:51.767350 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde1e96c-a908-4c50-bf10-2268868796aa None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:51.767626 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde1e96c-a908-4c50-bf10-2268868796aa None admin] PATH_INFO: `/v3/projects` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:51.768471 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde1e96c-a908-4c50-bf10-2268868796aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:51.768779 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde1e96c-a908-4c50-bf10-2268868796aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:51.770198 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde1e96c-a908-4c50-bf10-2268868796aa None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:51.787826 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 306/628] 10.222.0.44 () {56 vars in 1148 bytes} [Wed May 25 11:52:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:51.787826 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde1e96c-a908-4c50-bf10-2268868796aa None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:51.800376 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b91af-457e-419f-8d20-c84e2003e015 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:51.801826 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b91af-457e-419f-8d20-c84e2003e015 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:51.851175 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:51.894123 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde1e96c-a908-4c50-bf10-2268868796aa None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:51.913400 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 323/629] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 25 11:52:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 11:52:51.913400 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b91af-457e-419f-8d20-c84e2003e015 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:51.916847 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:51.934790 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a49f54d-1dc2-45af-b5ae-53fdf95d9ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:51.935458 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49f54d-1dc2-45af-b5ae-53fdf95d9ff0 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:51.935743 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49f54d-1dc2-45af-b5ae-53fdf95d9ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:51.936102 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49f54d-1dc2-45af-b5ae-53fdf95d9ff0 None admin] PATH_INFO: `/v3/domains` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:51.936821 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a49f54d-1dc2-45af-b5ae-53fdf95d9ff0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:51.937130 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a49f54d-1dc2-45af-b5ae-53fdf95d9ff0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:51.938498 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a49f54d-1dc2-45af-b5ae-53fdf95d9ff0 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:51.949646 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 307/630] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 25 11:52:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:51.950782 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a49f54d-1dc2-45af-b5ae-53fdf95d9ff0 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:52.026219 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b91af-457e-419f-8d20-c84e2003e015 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:52.054608 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a49f54d-1dc2-45af-b5ae-53fdf95d9ff0 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:52.066322 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9612c280-3c43-421f-bf4d-d59a007e451c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:52.066974 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612c280-3c43-421f-bf4d-d59a007e451c None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:52.067255 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612c280-3c43-421f-bf4d-d59a007e451c None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:52.067782 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612c280-3c43-421f-bf4d-d59a007e451c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:52.069080 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9612c280-3c43-421f-bf4d-d59a007e451c None admin] RBAC: Adding query filter params (role.id=33fd4a41fa554c6699a6c832f8eb793e, scope.project.id=57e08d47948142978437098a8120be78, user.id=9c940de37d2d453c875d3ab6c077a331) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:52.069527 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9612c280-3c43-421f-bf4d-d59a007e451c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:52.071324 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9612c280-3c43-421f-bf4d-d59a007e451c None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:52.078083 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 324/631] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 25 11:52:51 2022] GET /identity/v3/role_assignments?user.id=9c940de37d2d453c875d3ab6c077a331&scope.project.id=57e08d47948142978437098a8120be78&role.id=33fd4a41fa554c6699a6c832f8eb793e => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:52.079212 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9612c280-3c43-421f-bf4d-d59a007e451c None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:52.089138 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:52.103187 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e7d8f3-16ad-4771-8d8d-2d7bcffe72d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:52.104166 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7d8f3-16ad-4771-8d8d-2d7bcffe72d3 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:52.104517 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7d8f3-16ad-4771-8d8d-2d7bcffe72d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:52.104880 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7d8f3-16ad-4771-8d8d-2d7bcffe72d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:52.118250 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e7d8f3-16ad-4771-8d8d-2d7bcffe72d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:52.119945 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e7d8f3-16ad-4771-8d8d-2d7bcffe72d3 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:52.139219 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-e1e7d8f3-16ad-4771-8d8d-2d7bcffe72d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:52:52.139219 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:52.139219 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:52.139219 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:52.139219 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:52.139219 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:52.139219 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:52.139219 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:52.139219 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:52.139219 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:52.139219 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:52.139219 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:52.139219 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 11:52:52.139219 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 11:52:52.139219 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 11:52:52.140224 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 11:52:52.140224 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:52.140224 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:52.140224 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:52.140224 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:52.140224 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:52.140224 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:52.140224 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:52.140224 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:52:52.140224 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:52.140224 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:52.140224 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:52.140224 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:52.140224 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:52.140224 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:52.140224 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:52.140224 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:52.141123 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 11:52:52.141123 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 11:52:52.141123 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:52:52.141123 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:52:52.145355 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 308/632] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:52:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:52.147022 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e7d8f3-16ad-4771-8d8d-2d7bcffe72d3 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:52.172250 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:52.228329 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9612c280-3c43-421f-bf4d-d59a007e451c None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:52.267961 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e848508b-732d-4954-8c8f-0053e037e2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:52.268997 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848508b-732d-4954-8c8f-0053e037e2f4 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:52.269164 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848508b-732d-4954-8c8f-0053e037e2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:52.269543 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848508b-732d-4954-8c8f-0053e037e2f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:52.278406 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e848508b-732d-4954-8c8f-0053e037e2f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:52.279942 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e848508b-732d-4954-8c8f-0053e037e2f4 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:52.280515 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e7d8f3-16ad-4771-8d8d-2d7bcffe72d3 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:52.294835 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-e848508b-732d-4954-8c8f-0053e037e2f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 11:52:52.294835 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:52.294835 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:52.294835 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:52.294835 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:52.294835 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:52.294835 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:52.294835 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:52.294835 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:52.294835 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:52.294835 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:52.294835 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:52.294835 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 11:52:52.294835 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 11:52:52.294835 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 11:52:52.296021 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 11:52:52.296021 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:52.296021 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:52.296021 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:52.296021 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:52.296021 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:52.296021 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:52.296021 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:52.296021 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:52:52.296021 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:52.296021 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:52.296021 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:52.296021 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:52.296021 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:52.296021 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:52.296021 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:52.296021 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:52.297020 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 11:52:52.297020 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 11:52:52.297020 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 11:52:52.297020 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 11:52:52.297020 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 11:52:52.297020 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 11:52:52.297020 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 11:52:52.297020 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:52:52.297543 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 325/633] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 25 11:52:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:52.303204 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e848508b-732d-4954-8c8f-0053e037e2f4 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:52.325227 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e014e-e6d0-47ca-b7c5-f76b0a8b8bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:52.326186 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e014e-e6d0-47ca-b7c5-f76b0a8b8bd5 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:52.326623 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e014e-e6d0-47ca-b7c5-f76b0a8b8bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:52.327063 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e014e-e6d0-47ca-b7c5-f76b0a8b8bd5 None admin] PATH_INFO: `/v3/domains` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:52.328030 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5e014e-e6d0-47ca-b7c5-f76b0a8b8bd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:52.329094 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5e014e-e6d0-47ca-b7c5-f76b0a8b8bd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:52.330496 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5e014e-e6d0-47ca-b7c5-f76b0a8b8bd5 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:52.353768 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 309/634] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 25 11:52:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:52.359679 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e014e-e6d0-47ca-b7c5-f76b0a8b8bd5 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:52.436609 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:52.443195 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e848508b-732d-4954-8c8f-0053e037e2f4 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:52.471730 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:52.480861 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2381f56a-be45-43b9-874b-626d0791f36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:52.481574 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381f56a-be45-43b9-874b-626d0791f36a None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:52.481854 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381f56a-be45-43b9-874b-626d0791f36a None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:52.482127 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381f56a-be45-43b9-874b-626d0791f36a None admin] PATH_INFO: `/v3/projects` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:52.482956 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2381f56a-be45-43b9-874b-626d0791f36a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:52.483275 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2381f56a-be45-43b9-874b-626d0791f36a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:52.484794 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2381f56a-be45-43b9-874b-626d0791f36a None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:52.498246 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 326/635] 10.222.0.44 () {56 vars in 1148 bytes} [Wed May 25 11:52:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:52:52.503238 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e014e-e6d0-47ca-b7c5-f76b0a8b8bd5 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:52.504506 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2381f56a-be45-43b9-874b-626d0791f36a None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:52.556704 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8546fc54-cd50-4f9e-a3ad-10b6e2836b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:52.558899 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546fc54-cd50-4f9e-a3ad-10b6e2836b5f None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:52.559546 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546fc54-cd50-4f9e-a3ad-10b6e2836b5f None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:52.560132 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546fc54-cd50-4f9e-a3ad-10b6e2836b5f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:52.569963 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8546fc54-cd50-4f9e-a3ad-10b6e2836b5f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:52.572937 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8546fc54-cd50-4f9e-a3ad-10b6e2836b5f None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:52.592202 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-8546fc54-cd50-4f9e-a3ad-10b6e2836b5f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 11:52:52.592202 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:52.592202 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:52.592202 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:52.592202 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:52.592202 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:52.592202 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:52.592202 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:52.592202 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:52.592202 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:52.592202 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:52.592202 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:52.592202 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 11:52:52.592202 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 11:52:52.592202 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 11:52:52.593122 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 11:52:52.593122 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:52.593122 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:52.593122 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:52.593122 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:52.593122 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:52.593122 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:52.593122 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:52.593122 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:52:52.593122 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:52.593122 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:52.593122 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:52.593122 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:52.593122 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:52.593122 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:52.593122 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:52.593122 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:52.594028 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 11:52:52.594028 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 11:52:52.594028 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 11:52:52.594028 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 11:52:52.594028 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 11:52:52.594028 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 11:52:52.594028 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 11:52:52.594028 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:52:52.596740 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 310/636] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 25 11:52:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 11:52:52.601818 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8546fc54-cd50-4f9e-a3ad-10b6e2836b5f None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:52.619373 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2381f56a-be45-43b9-874b-626d0791f36a None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:52.667025 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4f5255-6142-4f79-a4b9-16f1bece5828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:52.667685 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f5255-6142-4f79-a4b9-16f1bece5828 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:52.667997 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f5255-6142-4f79-a4b9-16f1bece5828 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:52.668272 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f5255-6142-4f79-a4b9-16f1bece5828 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:52.669113 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4f5255-6142-4f79-a4b9-16f1bece5828 None admin] RBAC: Adding query filter params (role.id=33fd4a41fa554c6699a6c832f8eb793e, scope.project.id=57e08d47948142978437098a8120be78, user.id=bda1409f24a24f51b42043933e30a560) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:52.669428 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4f5255-6142-4f79-a4b9-16f1bece5828 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:52.671721 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4f5255-6142-4f79-a4b9-16f1bece5828 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:52.683831 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 327/637] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 25 11:52:52 2022] GET /identity/v3/role_assignments?user.id=bda1409f24a24f51b42043933e30a560&scope.project.id=57e08d47948142978437098a8120be78&role.id=33fd4a41fa554c6699a6c832f8eb793e => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:52.717362 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc6de6-9675-4701-8e9d-aa848cbbe755 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:52.717690 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc6de6-9675-4701-8e9d-aa848cbbe755 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:52.717915 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc6de6-9675-4701-8e9d-aa848cbbe755 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:52.719404 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 328/638] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:52:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:52:52.725484 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a3dbaa-7e42-4b9d-bc92-4fe0df4a4d72 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:52.725807 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a3dbaa-7e42-4b9d-bc92-4fe0df4a4d72 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:52.726040 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a3dbaa-7e42-4b9d-bc92-4fe0df4a4d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:52.745133 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-c7a3dbaa-7e42-4b9d-bc92-4fe0df4a4d72 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:52:52.746706 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-c7a3dbaa-7e42-4b9d-bc92-4fe0df4a4d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:52:52.747252 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:52.754353 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8546fc54-cd50-4f9e-a3ad-10b6e2836b5f None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:52.800931 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355db3ba-aa40-4ec3-b32b-4cc5aaabea93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:52.801998 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355db3ba-aa40-4ec3-b32b-4cc5aaabea93 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:52.802526 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355db3ba-aa40-4ec3-b32b-4cc5aaabea93 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:52.803895 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355db3ba-aa40-4ec3-b32b-4cc5aaabea93 None admin] PATH_INFO: `/v3/projects` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:52.805136 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355db3ba-aa40-4ec3-b32b-4cc5aaabea93 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:52.805664 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355db3ba-aa40-4ec3-b32b-4cc5aaabea93 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:52.808448 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355db3ba-aa40-4ec3-b32b-4cc5aaabea93 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:52.812097 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:52.828912 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 311/639] 10.222.0.44 () {56 vars in 1148 bytes} [Wed May 25 11:52:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:52:52.835380 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355db3ba-aa40-4ec3-b32b-4cc5aaabea93 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:52.851837 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 329/640] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:52:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 11:52:52.877654 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a3dbaa-7e42-4b9d-bc92-4fe0df4a4d72 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:52.973824 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355db3ba-aa40-4ec3-b32b-4cc5aaabea93 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:53.013845 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a3dbaa-7e42-4b9d-bc92-4fe0df4a4d72 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:53.023183 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9571b7dd-2421-4c3d-b497-d4dac44ca2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:53.024576 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571b7dd-2421-4c3d-b497-d4dac44ca2eb None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:53.025697 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571b7dd-2421-4c3d-b497-d4dac44ca2eb None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:53.026420 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571b7dd-2421-4c3d-b497-d4dac44ca2eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:53.027704 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9571b7dd-2421-4c3d-b497-d4dac44ca2eb None admin] RBAC: Adding query filter params (role.id=33fd4a41fa554c6699a6c832f8eb793e, scope.project.id=57e08d47948142978437098a8120be78, user.id=be63af25271b49b5903e8fe66a62b1d2) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:53.028185 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9571b7dd-2421-4c3d-b497-d4dac44ca2eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:53.030457 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9571b7dd-2421-4c3d-b497-d4dac44ca2eb None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:53.038414 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 312/641] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 25 11:52:52 2022] GET /identity/v3/role_assignments?user.id=be63af25271b49b5903e8fe66a62b1d2&scope.project.id=57e08d47948142978437098a8120be78&role.id=33fd4a41fa554c6699a6c832f8eb793e => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:52:53.056315 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bb1268-ddb9-41f0-919a-c1c55b8d8320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:53.057140 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb1268-ddb9-41f0-919a-c1c55b8d8320 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:53.057424 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb1268-ddb9-41f0-919a-c1c55b8d8320 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:53.057703 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb1268-ddb9-41f0-919a-c1c55b8d8320 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:53.070421 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bb1268-ddb9-41f0-919a-c1c55b8d8320 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:52:53.078774 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-85bb1268-ddb9-41f0-919a-c1c55b8d8320 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 11:52:53.078774 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:53.078774 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:53.078774 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:53.078774 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:53.078774 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:53.078774 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:53.078774 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:53.078774 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:53.078774 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:53.078774 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:53.078774 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:53.078774 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:52:53.078774 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:52:53.078774 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:52:53.078774 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:52:53.079884 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:52:53.079884 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:52:53.079884 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:52:53.079884 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:52:53.079884 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:53.079884 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:53.079884 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:53.079884 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:53.079884 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:53.079884 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:53.079884 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:53.079884 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:52:53.079884 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:53.079884 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:53.079884 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:53.079884 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:53.080804 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:53.080804 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:53.080804 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:53.080804 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:53.080804 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:52:53.080804 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:52:53.080804 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:52:53.080804 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:52:53.080804 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:52:53.080804 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:52:53.080804 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 11:52:53.080804 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:52:53.080804 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 330/642] 10.222.0.44 () {56 vars in 1096 bytes} [Wed May 25 11:52:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 11:52:53.088371 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9571b7dd-2421-4c3d-b497-d4dac44ca2eb None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:53.114344 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:53.210808 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9571b7dd-2421-4c3d-b497-d4dac44ca2eb None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:53.248774 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38336f3d-9525-472f-a9a0-d20e447eccb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:53.249452 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38336f3d-9525-472f-a9a0-d20e447eccb0 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:53.249736 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38336f3d-9525-472f-a9a0-d20e447eccb0 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:53.250014 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38336f3d-9525-472f-a9a0-d20e447eccb0 None admin] PATH_INFO: `/v3/roles` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:53.250758 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38336f3d-9525-472f-a9a0-d20e447eccb0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:53.251068 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38336f3d-9525-472f-a9a0-d20e447eccb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:53.252466 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38336f3d-9525-472f-a9a0-d20e447eccb0 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:53.261437 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 313/643] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 25 11:52:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:53.266809 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bb1268-ddb9-41f0-919a-c1c55b8d8320 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:53.314775 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:53.374353 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bb1268-ddb9-41f0-919a-c1c55b8d8320 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:53.408290 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2676e9c-6a6e-40b2-a386-186afb31edfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:53.409087 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2676e9c-6a6e-40b2-a386-186afb31edfd None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:53.409371 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2676e9c-6a6e-40b2-a386-186afb31edfd None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:53.409647 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2676e9c-6a6e-40b2-a386-186afb31edfd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:53.420989 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2676e9c-6a6e-40b2-a386-186afb31edfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:53.422442 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2676e9c-6a6e-40b2-a386-186afb31edfd None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:53.439502 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-b2676e9c-6a6e-40b2-a386-186afb31edfd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:52:53.439502 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:53.439502 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:53.439502 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:53.439502 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:53.439502 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:53.439502 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:53.439502 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:53.439502 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:53.439502 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:53.439502 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:53.439502 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:53.439502 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 11:52:53.439502 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 11:52:53.439502 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 11:52:53.440488 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 11:52:53.440488 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:53.440488 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:53.440488 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:53.440488 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:53.440488 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:53.440488 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:53.440488 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:53.440488 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:52:53.440488 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:53.440488 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:53.440488 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:53.440488 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:53.440488 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:53.440488 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:53.440488 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:53.440488 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:53.441389 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 11:52:53.441389 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 11:52:53.441389 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:52:53.441389 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:52:53.441389 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 331/644] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:52:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 11:52:53.447993 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38336f3d-9525-472f-a9a0-d20e447eccb0 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:53.535922 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:53.556551 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38336f3d-9525-472f-a9a0-d20e447eccb0 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:53.592552 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d10e17-b2d8-416a-a26e-09d9f0dfa9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:53.594038 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d10e17-b2d8-416a-a26e-09d9f0dfa9b6 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:53.594533 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d10e17-b2d8-416a-a26e-09d9f0dfa9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:53.595025 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d10e17-b2d8-416a-a26e-09d9f0dfa9b6 None admin] PATH_INFO: `/v3/domains` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:53.595981 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d10e17-b2d8-416a-a26e-09d9f0dfa9b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:53.596499 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d10e17-b2d8-416a-a26e-09d9f0dfa9b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:53.598100 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d10e17-b2d8-416a-a26e-09d9f0dfa9b6 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:53.611017 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 314/645] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 25 11:52:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:53.616639 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2676e9c-6a6e-40b2-a386-186afb31edfd None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:53.720274 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2676e9c-6a6e-40b2-a386-186afb31edfd None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:53.724094 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:53.756897 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c0413-7da1-4c43-8d36-2da813d253cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:53.758026 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c0413-7da1-4c43-8d36-2da813d253cd None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:53.758538 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c0413-7da1-4c43-8d36-2da813d253cd None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:53.759047 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c0413-7da1-4c43-8d36-2da813d253cd None admin] PATH_INFO: `/v3/users/nova` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:53.767205 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6c0413-7da1-4c43-8d36-2da813d253cd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:53.769028 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6c0413-7da1-4c43-8d36-2da813d253cd None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:53.783586 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-ec6c0413-7da1-4c43-8d36-2da813d253cd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 11:52:53.783586 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:53.783586 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:53.783586 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:53.783586 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:53.783586 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:53.783586 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:53.783586 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:53.783586 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:53.783586 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:53.783586 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:53.783586 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:53.783586 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 11:52:53.783586 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 11:52:53.783586 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 11:52:53.783586 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 11:52:53.784578 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:53.784578 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:53.784578 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 11:52:53.784578 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 11:52:53.784578 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 11:52:53.784578 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 11:52:53.784578 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:53.784578 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:53.784578 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:53.784578 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:53.784578 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:53.784578 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:52:53.784578 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:53.784578 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:53.784578 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:53.784578 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:53.784578 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:53.784578 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:53.785515 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:53.785515 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:53.785515 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 11:52:53.785515 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 11:52:53.785515 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 11:52:53.785515 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 11:52:53.785515 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 11:52:53.785515 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 11:52:53.785515 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 11:52:53.785515 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:52:53.792145 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 332/646] 10.222.0.44 () {56 vars in 1093 bytes} [Wed May 25 11:52:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:53.794442 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d10e17-b2d8-416a-a26e-09d9f0dfa9b6 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:53.901235 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d10e17-b2d8-416a-a26e-09d9f0dfa9b6 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:53.941387 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751903d3-97fb-4723-ad99-045ef8d0f198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:53.942429 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751903d3-97fb-4723-ad99-045ef8d0f198 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:53.942923 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751903d3-97fb-4723-ad99-045ef8d0f198 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:53.943406 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751903d3-97fb-4723-ad99-045ef8d0f198 None admin] PATH_INFO: `/v3/users` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:53.944507 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751903d3-97fb-4723-ad99-045ef8d0f198 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:53.945058 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751903d3-97fb-4723-ad99-045ef8d0f198 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:53.946751 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751903d3-97fb-4723-ad99-045ef8d0f198 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:53.962704 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:53.968251 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 315/647] 10.222.0.44 () {56 vars in 1133 bytes} [Wed May 25 11:52:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:53.974482 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c0413-7da1-4c43-8d36-2da813d253cd None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:54.085803 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c0413-7da1-4c43-8d36-2da813d253cd None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:54.120322 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0978d474-8c38-407b-8609-f54b6604d49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:54.120966 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978d474-8c38-407b-8609-f54b6604d49d None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:54.121246 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978d474-8c38-407b-8609-f54b6604d49d None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:54.121518 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978d474-8c38-407b-8609-f54b6604d49d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:54.148337 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:54.191093 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0978d474-8c38-407b-8609-f54b6604d49d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:54.192579 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0978d474-8c38-407b-8609-f54b6604d49d None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:54.292516 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 333/648] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 25 11:52:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 11:52:54.298368 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751903d3-97fb-4723-ad99-045ef8d0f198 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:54.413819 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751903d3-97fb-4723-ad99-045ef8d0f198 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:54.449729 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2b5849-aa7c-4b1a-b214-d8090122565c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:54.450534 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b5849-aa7c-4b1a-b214-d8090122565c None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:54.450819 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b5849-aa7c-4b1a-b214-d8090122565c None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:54.451098 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b5849-aa7c-4b1a-b214-d8090122565c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:54.461641 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2b5849-aa7c-4b1a-b214-d8090122565c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:54.463672 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2b5849-aa7c-4b1a-b214-d8090122565c None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:54.481522 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-7d2b5849-aa7c-4b1a-b214-d8090122565c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:52:54.481522 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:54.481522 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:54.481522 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:54.481522 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:54.481522 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:54.481522 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:54.481522 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:54.481522 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:54.481522 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:54.481522 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:54.481522 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:54.481522 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 11:52:54.481522 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 11:52:54.481522 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 11:52:54.482472 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 11:52:54.482472 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:54.482472 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:54.482472 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:54.482472 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:54.482472 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:54.482472 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:54.482472 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:54.482472 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:52:54.482472 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:54.482472 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:54.482472 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:54.482472 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:54.482472 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:54.482472 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:54.482472 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:54.482472 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:54.483379 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 11:52:54.483379 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 11:52:54.483379 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:52:54.483379 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:52:54.483379 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 316/649] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:52:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:54.489687 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0978d474-8c38-407b-8609-f54b6604d49d None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:54.541708 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cdd5a6-3569-4111-b0fa-200a24cb7242 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:54.542028 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cdd5a6-3569-4111-b0fa-200a24cb7242 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:54.542256 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cdd5a6-3569-4111-b0fa-200a24cb7242 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:54.543818 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 317/650] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 11:52:54.549599 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c86d3-5b6e-4cd5-9d63-acdaebbd8a3b None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:54.549895 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c86d3-5b6e-4cd5-9d63-acdaebbd8a3b None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:54.550177 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c86d3-5b6e-4cd5-9d63-acdaebbd8a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:54.551413 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:54.570954 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-100c86d3-5b6e-4cd5-9d63-acdaebbd8a3b None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:52:54.573065 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-100c86d3-5b6e-4cd5-9d63-acdaebbd8a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:52:54.607371 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0978d474-8c38-407b-8609-f54b6604d49d None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:54.628254 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:54.643947 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 318/651] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:52:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 11:52:54.656930 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7805b6b-7976-4c1a-b704-67947ad2951d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:54.657928 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7805b6b-7976-4c1a-b704-67947ad2951d None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:54.658420 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7805b6b-7976-4c1a-b704-67947ad2951d None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:54.658917 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7805b6b-7976-4c1a-b704-67947ad2951d None admin] PATH_INFO: `/v3/domains` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:54.659876 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7805b6b-7976-4c1a-b704-67947ad2951d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:54.660408 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7805b6b-7976-4c1a-b704-67947ad2951d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:54.661995 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7805b6b-7976-4c1a-b704-67947ad2951d None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:54.668400 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100c86d3-5b6e-4cd5-9d63-acdaebbd8a3b None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:54.685222 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 334/652] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 25 11:52:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:54.691262 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7805b6b-7976-4c1a-b704-67947ad2951d None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:54.800126 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100c86d3-5b6e-4cd5-9d63-acdaebbd8a3b None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:54.805549 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7805b6b-7976-4c1a-b704-67947ad2951d None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:54.821542 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:54.843028 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a090c6-679a-4bd5-b1e0-d3955e436e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:54.843866 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a090c6-679a-4bd5-b1e0-d3955e436e5b None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:54.844174 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a090c6-679a-4bd5-b1e0-d3955e436e5b None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:54.844436 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a090c6-679a-4bd5-b1e0-d3955e436e5b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:54.845122 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a090c6-679a-4bd5-b1e0-d3955e436e5b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:54.846481 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a090c6-679a-4bd5-b1e0-d3955e436e5b None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:54.847647 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f65c42a-b64f-4e77-a27a-5803feecf499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:54.849775 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65c42a-b64f-4e77-a27a-5803feecf499 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:54.850361 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65c42a-b64f-4e77-a27a-5803feecf499 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:54.850841 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65c42a-b64f-4e77-a27a-5803feecf499 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:54.858842 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f65c42a-b64f-4e77-a27a-5803feecf499 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:54.860544 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f65c42a-b64f-4e77-a27a-5803feecf499 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:54.862289 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-d2a090c6-679a-4bd5-b1e0-d3955e436e5b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 11:52:54.862289 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:54.862289 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 11:52:54.862289 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 11:52:54.862289 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 11:52:54.862289 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 11:52:54.862289 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 11:52:54.862289 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 11:52:54.862289 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 11:52:54.862289 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:52:54.862289 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 11:52:54.862289 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:52:54.862289 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:54.862289 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:54.862289 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:54.862289 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:54.863228 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:54.863228 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:54.863228 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:54.863228 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:54.863228 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:54.863228 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:54.863228 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:54.863228 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 11:52:54.863228 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 11:52:54.863228 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 11:52:54.863228 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 11:52:54.863228 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:54.863228 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:54.863228 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:54.863228 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:54.863228 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:54.864452 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:54.864452 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:54.864452 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:52:54.864452 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:54.864452 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:54.864452 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:54.864452 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:54.864452 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:54.864452 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:54.864452 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:54.864452 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:54.864452 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 11:52:54.864452 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 11:52:54.864452 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 11:52:54.864452 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:52:54.870034 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 319/653] 10.222.0.44 () {56 vars in 1129 bytes} [Wed May 25 11:52:54 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 11:52:54.871046 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a090c6-679a-4bd5-b1e0-d3955e436e5b None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:54.889260 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-8f65c42a-b64f-4e77-a27a-5803feecf499 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 11:52:54.889260 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:54.889260 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:54.889260 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:54.889260 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:54.889260 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:54.889260 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:54.889260 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:54.889260 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:54.889260 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:54.889260 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:54.889260 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:54.889260 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 11:52:54.889260 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 11:52:54.889260 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 11:52:54.890204 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 11:52:54.890204 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:54.890204 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:54.890204 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:54.890204 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:54.890204 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:54.890204 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:54.890204 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:54.890204 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:52:54.890204 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:54.890204 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:54.890204 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:54.890204 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:54.890204 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:54.890204 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:54.890204 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:54.890204 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:54.891086 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 11:52:54.891086 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 11:52:54.891086 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 11:52:54.891086 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 11:52:54.891086 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 11:52:54.891086 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 11:52:54.891086 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 11:52:54.891086 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:52:54.895293 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 335/654] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 25 11:52:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:54.896775 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f65c42a-b64f-4e77-a27a-5803feecf499 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:54.933527 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:54.995094 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a090c6-679a-4bd5-b1e0-d3955e436e5b None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:55.032971 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f65c42a-b64f-4e77-a27a-5803feecf499 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:55.038215 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8995d44-c0c7-46b9-98ad-47413b6627ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:55.039179 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8995d44-c0c7-46b9-98ad-47413b6627ad None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:55.039702 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8995d44-c0c7-46b9-98ad-47413b6627ad None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:55.040312 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8995d44-c0c7-46b9-98ad-47413b6627ad None admin] PATH_INFO: `/v3/services` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:55.041347 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8995d44-c0c7-46b9-98ad-47413b6627ad None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:55.041875 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8995d44-c0c7-46b9-98ad-47413b6627ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:55.043660 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8995d44-c0c7-46b9-98ad-47413b6627ad None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:55.049756 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 320/655] 10.222.0.44 () {56 vars in 1124 bytes} [Wed May 25 11:52:54 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:55.056373 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8995d44-c0c7-46b9-98ad-47413b6627ad None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:55.078624 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0406248e-0199-40ac-bbd8-dceca59970cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:55.079672 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406248e-0199-40ac-bbd8-dceca59970cb None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:55.080019 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406248e-0199-40ac-bbd8-dceca59970cb None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:55.080303 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406248e-0199-40ac-bbd8-dceca59970cb None admin] PATH_INFO: `/v3/projects` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:55.081386 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0406248e-0199-40ac-bbd8-dceca59970cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:55.081713 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0406248e-0199-40ac-bbd8-dceca59970cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:55.083320 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0406248e-0199-40ac-bbd8-dceca59970cb None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:55.099949 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 336/656] 10.222.0.44 () {56 vars in 1148 bytes} [Wed May 25 11:52:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:55.105266 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0406248e-0199-40ac-bbd8-dceca59970cb None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:55.150774 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:55.192536 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8995d44-c0c7-46b9-98ad-47413b6627ad None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:55.203739 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:55.230517 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f18e42-9205-42a0-a2f7-032ba6000ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:55.231194 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f18e42-9205-42a0-a2f7-032ba6000ea9 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:55.231481 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f18e42-9205-42a0-a2f7-032ba6000ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:55.231762 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f18e42-9205-42a0-a2f7-032ba6000ea9 None admin] PATH_INFO: `/v3/services` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:55.232501 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f18e42-9205-42a0-a2f7-032ba6000ea9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:55.232816 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f18e42-9205-42a0-a2f7-032ba6000ea9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:55.234255 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f18e42-9205-42a0-a2f7-032ba6000ea9 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:55.238764 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0406248e-0199-40ac-bbd8-dceca59970cb None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:55.240063 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 321/657] 10.222.0.44 () {56 vars in 1124 bytes} [Wed May 25 11:52:55 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:52:55.245403 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb4d75-5307-458a-b9cb-a1407c3db717 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:55.245964 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb4d75-5307-458a-b9cb-a1407c3db717 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:55.246424 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb4d75-5307-458a-b9cb-a1407c3db717 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:55.253535 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 322/658] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:52:55 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:52:55.254656 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617eddb3-74f9-404f-a7de-73d9318538e6 None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:55.254950 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617eddb3-74f9-404f-a7de-73d9318538e6 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:55.255233 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617eddb3-74f9-404f-a7de-73d9318538e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:55.277794 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-617eddb3-74f9-404f-a7de-73d9318538e6 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:52:55.279023 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-617eddb3-74f9-404f-a7de-73d9318538e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:52:55.294564 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de738e82-4dc8-4608-ad90-a08b410132fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:55.296038 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de738e82-4dc8-4608-ad90-a08b410132fd None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:55.297231 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de738e82-4dc8-4608-ad90-a08b410132fd None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:55.297948 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de738e82-4dc8-4608-ad90-a08b410132fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:55.299203 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de738e82-4dc8-4608-ad90-a08b410132fd None admin] RBAC: Adding query filter params (role.id=2fe5c1214bcc4c1bafa5a4545161518d, scope.project.id=57e08d47948142978437098a8120be78, user.id=d25d7a439361492d8d7ba018531a2e7a) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:55.300040 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de738e82-4dc8-4608-ad90-a08b410132fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:55.301608 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de738e82-4dc8-4608-ad90-a08b410132fd None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:55.309506 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 337/659] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 25 11:52:55 2022] GET /identity/v3/role_assignments?user.id=d25d7a439361492d8d7ba018531a2e7a&scope.project.id=57e08d47948142978437098a8120be78&role.id=2fe5c1214bcc4c1bafa5a4545161518d => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:55.378931 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 323/660] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:52:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 11:52:55.405113 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de738e82-4dc8-4608-ad90-a08b410132fd None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:55.526992 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5adaff-8b5f-4279-820d-771e96a3aedf None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:55.527285 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5adaff-8b5f-4279-820d-771e96a3aedf None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:55.527566 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5adaff-8b5f-4279-820d-771e96a3aedf None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:55.529889 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 324/661] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:52:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:52:55.530579 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:55.535508 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5329e-7f81-4ef9-b522-732daac74865 None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:55.535875 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5329e-7f81-4ef9-b522-732daac74865 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:55.536129 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c5329e-7f81-4ef9-b522-732daac74865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:55.538563 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de738e82-4dc8-4608-ad90-a08b410132fd None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:55.555892 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-60c5329e-7f81-4ef9-b522-732daac74865 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:52:55.557078 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-60c5329e-7f81-4ef9-b522-732daac74865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:52:55.585839 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb9456-0eb9-4450-a8e2-03ceeaae24e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:55.587783 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb9456-0eb9-4450-a8e2-03ceeaae24e9 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:55.588106 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb9456-0eb9-4450-a8e2-03ceeaae24e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:55.588388 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb9456-0eb9-4450-a8e2-03ceeaae24e9 None admin] PATH_INFO: `/v3/services/image` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:55.589320 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbb9456-0eb9-4450-a8e2-03ceeaae24e9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:55.590827 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbb9456-0eb9-4450-a8e2-03ceeaae24e9 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:55.608955 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-9cbb9456-0eb9-4450-a8e2-03ceeaae24e9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 25 11:52:55.608955 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:55.608955 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 11:52:55.608955 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 11:52:55.608955 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 11:52:55.608955 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 11:52:55.608955 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 11:52:55.608955 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 11:52:55.608955 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 11:52:55.608955 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:52:55.608955 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 11:52:55.608955 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:52:55.608955 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:55.608955 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:55.608955 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:55.608955 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:55.608955 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:55.610013 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:55.610013 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:55.610013 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:55.610013 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:55.610013 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:55.610013 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:55.610013 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 11:52:55.610013 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 11:52:55.610013 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 11:52:55.610013 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 11:52:55.610013 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:55.610013 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:55.610013 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:55.610013 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:55.610013 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:55.610013 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:55.610862 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:55.610862 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:52:55.610862 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:55.610862 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:55.610862 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:55.610862 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:55.610862 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:55.610862 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:55.610862 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:55.610862 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:55.610862 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 11:52:55.610862 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 11:52:55.610862 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 11:52:55.610862 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:52:55.610862 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 338/662] 10.222.0.44 () {56 vars in 1105 bytes} [Wed May 25 11:52:55 2022] GET /identity/v3/services/image => generated 86 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:55.619235 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb9456-0eb9-4450-a8e2-03ceeaae24e9 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:55.641664 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 325/663] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:52:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 11:52:55.665364 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5329e-7f81-4ef9-b522-732daac74865 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:55.703423 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:55.754292 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb9456-0eb9-4450-a8e2-03ceeaae24e9 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:55.791077 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b82babc-16c3-4a4f-a8ec-83dcfddfa357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:55.791745 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82babc-16c3-4a4f-a8ec-83dcfddfa357 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:55.792074 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82babc-16c3-4a4f-a8ec-83dcfddfa357 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:55.792346 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82babc-16c3-4a4f-a8ec-83dcfddfa357 None admin] PATH_INFO: `/v3/services` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:55.793056 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b82babc-16c3-4a4f-a8ec-83dcfddfa357 None admin] RBAC: Adding query filter params (name=image) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:55.793365 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b82babc-16c3-4a4f-a8ec-83dcfddfa357 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:55.794781 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b82babc-16c3-4a4f-a8ec-83dcfddfa357 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:55.801655 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c5329e-7f81-4ef9-b522-732daac74865 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:55.810494 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 339/664] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:52:55 2022] GET /identity/v3/services?name=image => generated 122 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:52:55.813526 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b82babc-16c3-4a4f-a8ec-83dcfddfa357 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:55.843594 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d4ed4-9eb6-4a78-8e4c-33a6d897a518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:55.844483 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d4ed4-9eb6-4a78-8e4c-33a6d897a518 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:55.844770 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d4ed4-9eb6-4a78-8e4c-33a6d897a518 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:55.845052 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d4ed4-9eb6-4a78-8e4c-33a6d897a518 None admin] PATH_INFO: `/v3/services/network` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:55.845714 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9d4ed4-9eb6-4a78-8e4c-33a6d897a518 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:55.847108 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9d4ed4-9eb6-4a78-8e4c-33a6d897a518 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:55.851366 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:55.859232 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-4c9d4ed4-9eb6-4a78-8e4c-33a6d897a518 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 25 11:52:55.859232 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:55.859232 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 11:52:55.859232 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 11:52:55.859232 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 11:52:55.859232 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 11:52:55.859232 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 11:52:55.859232 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 11:52:55.859232 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 11:52:55.859232 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:52:55.859232 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 11:52:55.859232 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:52:55.859232 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:55.859232 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:55.859232 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:55.859232 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:55.859232 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:55.860274 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:55.860274 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:55.860274 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:55.860274 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:55.860274 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:55.860274 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:55.860274 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 11:52:55.860274 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 11:52:55.860274 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 11:52:55.860274 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 11:52:55.860274 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:55.860274 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:55.860274 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:55.860274 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:55.860274 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:55.860274 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:55.861138 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:55.861138 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:52:55.861138 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:55.861138 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:55.861138 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:55.861138 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:55.861138 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:55.861138 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:55.861138 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:55.861138 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:55.861138 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 11:52:55.861138 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 11:52:55.861138 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 11:52:55.861138 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:52:55.861138 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 326/665] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 25 11:52:55 2022] GET /identity/v3/services/network => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 11:52:55.867835 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d4ed4-9eb6-4a78-8e4c-33a6d897a518 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:55.957373 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b82babc-16c3-4a4f-a8ec-83dcfddfa357 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:55.994123 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:55.998944 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d4ed4-9eb6-4a78-8e4c-33a6d897a518 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:56.005137 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03531f4d-cfb6-403a-9198-e91f10b16ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:56.005896 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03531f4d-cfb6-403a-9198-e91f10b16ebb None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:56.006249 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03531f4d-cfb6-403a-9198-e91f10b16ebb None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:56.006596 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03531f4d-cfb6-403a-9198-e91f10b16ebb None admin] PATH_INFO: `/v3/services` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:56.007381 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03531f4d-cfb6-403a-9198-e91f10b16ebb None admin] RBAC: Adding query filter params (type=image) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:56.007761 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03531f4d-cfb6-403a-9198-e91f10b16ebb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:56.009813 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03531f4d-cfb6-403a-9198-e91f10b16ebb None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:56.018434 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 340/666] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:52:55 2022] GET /identity/v3/services?type=image => generated 122 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:52:56.041361 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e572983-aea0-4b8b-97ac-388372d79b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:56.042321 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e572983-aea0-4b8b-97ac-388372d79b48 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:56.042782 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e572983-aea0-4b8b-97ac-388372d79b48 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:56.043210 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e572983-aea0-4b8b-97ac-388372d79b48 None admin] PATH_INFO: `/v3/services` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:56.044295 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e572983-aea0-4b8b-97ac-388372d79b48 None admin] RBAC: Adding query filter params (name=network) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:56.044775 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e572983-aea0-4b8b-97ac-388372d79b48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:56.046474 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e572983-aea0-4b8b-97ac-388372d79b48 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:56.052660 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 327/667] 10.222.0.44 () {56 vars in 1112 bytes} [Wed May 25 11:52:55 2022] GET /identity/v3/services?name=network => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:52:56.063934 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03531f4d-cfb6-403a-9198-e91f10b16ebb None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:56.163770 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:56.175714 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03531f4d-cfb6-403a-9198-e91f10b16ebb None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:56.211773 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b8794-1886-4451-bea5-9d9bcac610f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:56.213000 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b8794-1886-4451-bea5-9d9bcac610f4 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:56.213281 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b8794-1886-4451-bea5-9d9bcac610f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:56.213664 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b8794-1886-4451-bea5-9d9bcac610f4 None admin] PATH_INFO: `/v3/services` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:56.214377 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7b8794-1886-4451-bea5-9d9bcac610f4 None admin] RBAC: Adding query filter params (type=network) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:56.214688 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7b8794-1886-4451-bea5-9d9bcac610f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:56.216079 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7b8794-1886-4451-bea5-9d9bcac610f4 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:56.223862 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 341/668] 10.222.0.44 () {56 vars in 1112 bytes} [Wed May 25 11:52:56 2022] GET /identity/v3/services?type=network => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:57.622657 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e296f-0c1f-45a4-b43f-b1bd8ffd5e67 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:57.623153 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e296f-0c1f-45a4-b43f-b1bd8ffd5e67 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:57.623153 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e296f-0c1f-45a4-b43f-b1bd8ffd5e67 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:57.624802 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 328/669] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:52:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:52:57.629884 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc1211-dd29-4b11-b642-8b48782ce53e None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:57.630276 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc1211-dd29-4b11-b642-8b48782ce53e None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:57.630441 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc1211-dd29-4b11-b642-8b48782ce53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:57.640706 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85da46-fffd-46fb-b6eb-8a891850a394 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:57.641000 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85da46-fffd-46fb-b6eb-8a891850a394 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:57.641283 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85da46-fffd-46fb-b6eb-8a891850a394 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:57.642898 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 329/670] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:52:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 11:52:57.647958 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0910b2-6998-4ca0-b78d-61e792dc02f8 None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:57.648150 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-96dc1211-dd29-4b11-b642-8b48782ce53e None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:52:57.648265 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0910b2-6998-4ca0-b78d-61e792dc02f8 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:57.648524 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0910b2-6998-4ca0-b78d-61e792dc02f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:57.649289 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-96dc1211-dd29-4b11-b642-8b48782ce53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:52:57.665555 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-9d0910b2-6998-4ca0-b78d-61e792dc02f8 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:52:57.666736 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-9d0910b2-6998-4ca0-b78d-61e792dc02f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:52:57.737362 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 342/671] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:52:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 11:52:57.752449 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 330/672] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:52:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 11:52:57.766854 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc1211-dd29-4b11-b642-8b48782ce53e None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:57.782557 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0910b2-6998-4ca0-b78d-61e792dc02f8 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:57.862601 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:57.881491 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc1211-dd29-4b11-b642-8b48782ce53e None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:57.903978 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:57.920012 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0910b2-6998-4ca0-b78d-61e792dc02f8 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:57.923535 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7d4ce-ce12-4405-b65e-3fd44546a3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:57.924495 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7d4ce-ce12-4405-b65e-3fd44546a3e4 None admin] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:57.924939 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7d4ce-ce12-4405-b65e-3fd44546a3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:57.925363 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7d4ce-ce12-4405-b65e-3fd44546a3e4 None admin] PATH_INFO: `/v3/services` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:57.926245 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b7d4ce-ce12-4405-b65e-3fd44546a3e4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:57.927780 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b7d4ce-ce12-4405-b65e-3fd44546a3e4 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:57.945135 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 343/673] 10.222.0.44 () {60 vars in 1141 bytes} [Wed May 25 11:52:57 2022] POST /identity/v3/services => generated 251 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 11:52:57.973989 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5694a-f00c-4318-9509-97fad3d95b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:57.975274 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5694a-f00c-4318-9509-97fad3d95b6e None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:57.975952 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5694a-f00c-4318-9509-97fad3d95b6e None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:57.976419 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5694a-f00c-4318-9509-97fad3d95b6e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:57.990617 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f5694a-f00c-4318-9509-97fad3d95b6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:52:58.000920 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-e7f5694a-f00c-4318-9509-97fad3d95b6e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 11:52:58.000920 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:58.000920 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:58.000920 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:58.000920 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:58.000920 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:58.000920 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:58.000920 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:58.000920 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:58.000920 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:58.000920 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:58.000920 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:58.000920 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:52:58.000920 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:52:58.000920 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:52:58.000920 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:52:58.001997 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:52:58.001997 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:52:58.001997 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:52:58.001997 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:52:58.001997 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:58.001997 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:58.001997 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:58.001997 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:58.001997 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:58.001997 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:58.001997 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:58.001997 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:52:58.001997 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:58.001997 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:58.001997 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:58.001997 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:58.002847 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:58.002847 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:58.002847 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:58.002847 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:58.002847 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:52:58.002847 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:52:58.002847 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:52:58.002847 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:52:58.002847 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:52:58.002847 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:52:58.002847 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 11:52:58.002847 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:52:58.005417 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 331/674] 10.222.0.44 () {56 vars in 1096 bytes} [Wed May 25 11:52:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:58.011954 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7d4ce-ce12-4405-b65e-3fd44546a3e4 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:58.131044 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7d4ce-ce12-4405-b65e-3fd44546a3e4 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:58.173819 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8306b6-f154-4e3d-9723-32722d5b8986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:58.174502 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8306b6-f154-4e3d-9723-32722d5b8986 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:58.174788 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8306b6-f154-4e3d-9723-32722d5b8986 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:58.175066 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8306b6-f154-4e3d-9723-32722d5b8986 None admin] PATH_INFO: `/v3/roles` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:58.175875 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8306b6-f154-4e3d-9723-32722d5b8986 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:58.180527 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8306b6-f154-4e3d-9723-32722d5b8986 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:58.180527 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8306b6-f154-4e3d-9723-32722d5b8986 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:58.188857 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 344/675] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 25 11:52:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:58.195537 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5694a-f00c-4318-9509-97fad3d95b6e None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:58.307339 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5694a-f00c-4318-9509-97fad3d95b6e None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:58.320730 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282cc365-b8c2-44cf-9b15-20fd60bcd35b None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:58.321072 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282cc365-b8c2-44cf-9b15-20fd60bcd35b None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:58.321819 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282cc365-b8c2-44cf-9b15-20fd60bcd35b None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:58.323539 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 345/676] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:52:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 11:52:58.329221 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbcc1e7-b74d-4a3a-8342-5d44de7dd5f2 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:58.329536 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbcc1e7-b74d-4a3a-8342-5d44de7dd5f2 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:58.329781 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbcc1e7-b74d-4a3a-8342-5d44de7dd5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:58.342852 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:58.351229 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce89b464-93f7-4ec7-9d62-82c4af3ac8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:58.352080 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89b464-93f7-4ec7-9d62-82c4af3ac8fe None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:58.352362 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89b464-93f7-4ec7-9d62-82c4af3ac8fe None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:58.352669 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89b464-93f7-4ec7-9d62-82c4af3ac8fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:58.353508 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-ebbcc1e7-b74d-4a3a-8342-5d44de7dd5f2 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:52:58.354995 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-ebbcc1e7-b74d-4a3a-8342-5d44de7dd5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:52:58.364108 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce89b464-93f7-4ec7-9d62-82c4af3ac8fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:58.365564 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce89b464-93f7-4ec7-9d62-82c4af3ac8fe None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:58.373794 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:58.386082 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-ce89b464-93f7-4ec7-9d62-82c4af3ac8fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:52:58.386082 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:58.386082 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:58.386082 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:58.386082 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:58.386082 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:58.386082 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:58.386082 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:58.386082 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:58.386082 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:58.386082 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:58.386082 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:58.386082 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 11:52:58.386082 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 11:52:58.386082 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 11:52:58.387015 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 11:52:58.387015 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:58.387015 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:58.387015 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:58.387015 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:58.387015 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:58.387015 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:58.387015 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:58.387015 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:52:58.387015 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:58.387015 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:58.387015 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:58.387015 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:58.387015 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:58.387015 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:58.387015 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:58.387015 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:58.388360 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 11:52:58.388360 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 11:52:58.388360 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:52:58.388360 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:52:58.390440 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 332/677] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:52:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:58.396230 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce89b464-93f7-4ec7-9d62-82c4af3ac8fe None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:58.429166 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 346/678] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:52:58 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 11:52:58.453071 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbcc1e7-b74d-4a3a-8342-5d44de7dd5f2 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:58.509947 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce89b464-93f7-4ec7-9d62-82c4af3ac8fe None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:58.551728 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e002085-1931-4436-9637-a35c8593add1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:58.552981 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e002085-1931-4436-9637-a35c8593add1 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:58.553472 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e002085-1931-4436-9637-a35c8593add1 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:58.554232 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e002085-1931-4436-9637-a35c8593add1 None admin] PATH_INFO: `/v3/domains` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:58.555154 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e002085-1931-4436-9637-a35c8593add1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:58.555692 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e002085-1931-4436-9637-a35c8593add1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:58.557936 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e002085-1931-4436-9637-a35c8593add1 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:58.568013 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbcc1e7-b74d-4a3a-8342-5d44de7dd5f2 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:58.578582 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 333/679] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 25 11:52:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:52:58.578582 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a0d035-234e-474b-b38f-90597bc89916 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:58.578582 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a0d035-234e-474b-b38f-90597bc89916 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:58.578582 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a0d035-234e-474b-b38f-90597bc89916 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:58.578582 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 334/680] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:52:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:52:58.580495 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a0d035-234e-474b-b38f-90597bc89916 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:58.608910 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed9c668-b170-4955-8eb5-861cb646ca9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:58.609577 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed9c668-b170-4955-8eb5-861cb646ca9b None admin] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:58.609860 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed9c668-b170-4955-8eb5-861cb646ca9b None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:58.610136 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed9c668-b170-4955-8eb5-861cb646ca9b None admin] PATH_INFO: `/v3/services` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:58.610861 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed9c668-b170-4955-8eb5-861cb646ca9b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:58.612253 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed9c668-b170-4955-8eb5-861cb646ca9b None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:58.615310 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:58.627848 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 347/681] 10.222.0.44 () {60 vars in 1141 bytes} [Wed May 25 11:52:58 2022] POST /identity/v3/services => generated 242 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 11:52:58.628562 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a8564-9d28-4a42-9889-0555e7133ff9 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:58.628852 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a8564-9d28-4a42-9889-0555e7133ff9 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:58.629130 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a8564-9d28-4a42-9889-0555e7133ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:58.654656 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-d66a8564-9d28-4a42-9889-0555e7133ff9 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:52:58.657043 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:58.658733 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-d66a8564-9d28-4a42-9889-0555e7133ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:52:58.720883 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a0d035-234e-474b-b38f-90597bc89916 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:58.751346 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 348/682] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:52:58 2022] POST /identity/v3/auth/tokens => generated 999 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 11:52:58.773906 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a8930-4d8c-4f47-b71f-cb5733b7f226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:58.775691 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a8930-4d8c-4f47-b71f-cb5733b7f226 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:58.776334 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a8930-4d8c-4f47-b71f-cb5733b7f226 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:58.776822 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a8930-4d8c-4f47-b71f-cb5733b7f226 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:58.782552 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a8564-9d28-4a42-9889-0555e7133ff9 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:58.789825 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2a8930-4d8c-4f47-b71f-cb5733b7f226 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:58.793071 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2a8930-4d8c-4f47-b71f-cb5733b7f226 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:58.815231 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-3b2a8930-4d8c-4f47-b71f-cb5733b7f226 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 11:52:58.815231 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:58.815231 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:58.815231 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:58.815231 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:58.815231 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:58.815231 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:58.815231 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:58.815231 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:58.815231 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:58.815231 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:58.815231 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:58.815231 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 11:52:58.815231 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 11:52:58.815231 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 11:52:58.815231 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 11:52:58.816394 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:58.816394 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:58.816394 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 11:52:58.816394 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 11:52:58.816394 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 11:52:58.816394 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 11:52:58.816394 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:58.816394 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:58.816394 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:58.816394 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:58.816394 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:58.816394 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:52:58.816394 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:58.816394 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:58.816394 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:58.816394 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:58.816394 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:58.816394 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:58.822775 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:58.822775 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:58.822775 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 11:52:58.822775 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 11:52:58.822775 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 11:52:58.822775 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 11:52:58.822775 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 11:52:58.822775 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 11:52:58.822775 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 11:52:58.822775 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:52:58.822775 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 335/683] 10.222.0.44 () {56 vars in 1093 bytes} [Wed May 25 11:52:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:58.824829 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a8930-4d8c-4f47-b71f-cb5733b7f226 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:58.913922 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a8564-9d28-4a42-9889-0555e7133ff9 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:58.945328 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:58.964185 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c902481-3bc5-4c23-a9bb-ba206cf41935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:58.965251 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c902481-3bc5-4c23-a9bb-ba206cf41935 None admin] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:58.965693 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c902481-3bc5-4c23-a9bb-ba206cf41935 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:58.966092 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c902481-3bc5-4c23-a9bb-ba206cf41935 None admin] PATH_INFO: `/v3/services` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:58.966984 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c902481-3bc5-4c23-a9bb-ba206cf41935 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:58.967302 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a8930-4d8c-4f47-b71f-cb5733b7f226 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:58.968578 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c902481-3bc5-4c23-a9bb-ba206cf41935 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:58.986600 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:58.993313 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 349/684] 10.222.0.44 () {60 vars in 1141 bytes} [Wed May 25 11:52:58 2022] POST /identity/v3/services => generated 240 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 11:52:59.019263 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d021e56a-0c86-49f9-b0b2-6431c66fe64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:59.019996 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021e56a-0c86-49f9-b0b2-6431c66fe64b None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:59.020289 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021e56a-0c86-49f9-b0b2-6431c66fe64b None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:59.021613 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021e56a-0c86-49f9-b0b2-6431c66fe64b None admin] PATH_INFO: `/v3/users` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:59.021868 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d021e56a-0c86-49f9-b0b2-6431c66fe64b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:59.024013 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d021e56a-0c86-49f9-b0b2-6431c66fe64b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:59.024013 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d021e56a-0c86-49f9-b0b2-6431c66fe64b None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:59.047972 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 336/685] 10.222.0.44 () {56 vars in 1133 bytes} [Wed May 25 11:52:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:59.057014 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c902481-3bc5-4c23-a9bb-ba206cf41935 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:59.192298 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c902481-3bc5-4c23-a9bb-ba206cf41935 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:59.231702 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c71eca-0e17-4537-bd28-58695500583b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:59.232546 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c71eca-0e17-4537-bd28-58695500583b None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:59.232824 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c71eca-0e17-4537-bd28-58695500583b None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:59.233137 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c71eca-0e17-4537-bd28-58695500583b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:59.246203 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c71eca-0e17-4537-bd28-58695500583b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:59.247592 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c71eca-0e17-4537-bd28-58695500583b None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:59.265192 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-b6c71eca-0e17-4537-bd28-58695500583b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:52:59.265192 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:59.265192 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:59.265192 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:59.265192 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:59.265192 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:59.265192 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:59.265192 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:59.265192 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:59.265192 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:59.265192 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:59.265192 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:59.265192 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 11:52:59.265192 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 11:52:59.265192 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 11:52:59.266137 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 11:52:59.266137 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:59.266137 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:59.266137 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:59.266137 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:59.266137 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:59.266137 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:59.266137 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:59.266137 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:52:59.266137 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:59.266137 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:59.266137 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:59.266137 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:59.266137 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:59.266137 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:59.266137 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:59.266137 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:59.267334 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 11:52:59.267334 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 11:52:59.267334 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:52:59.267334 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:52:59.267334 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 350/686] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:52:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:59.273724 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d021e56a-0c86-49f9-b0b2-6431c66fe64b None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:59.377420 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d021e56a-0c86-49f9-b0b2-6431c66fe64b None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:59.417075 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af5f65-d043-41f9-85a5-a5a445f10216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:59.417075 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af5f65-d043-41f9-85a5-a5a445f10216 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:59.417075 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af5f65-d043-41f9-85a5-a5a445f10216 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:59.417451 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af5f65-d043-41f9-85a5-a5a445f10216 None admin] PATH_INFO: `/v3/domains` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:59.417989 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af5f65-d043-41f9-85a5-a5a445f10216 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:59.418302 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af5f65-d043-41f9-85a5-a5a445f10216 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:59.419688 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af5f65-d043-41f9-85a5-a5a445f10216 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:59.432465 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 337/687] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 25 11:52:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:59.437718 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c71eca-0e17-4537-bd28-58695500583b None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:59.483967 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:59.550675 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c71eca-0e17-4537-bd28-58695500583b None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:59.586707 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c1101-e45e-4d9b-a1df-745c8e54bb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:59.587983 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c1101-e45e-4d9b-a1df-745c8e54bb64 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:59.588477 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c1101-e45e-4d9b-a1df-745c8e54bb64 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:59.588966 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c1101-e45e-4d9b-a1df-745c8e54bb64 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:59.596312 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c1101-e45e-4d9b-a1df-745c8e54bb64 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:59.598000 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c1101-e45e-4d9b-a1df-745c8e54bb64 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:59.613539 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-f38c1101-e45e-4d9b-a1df-745c8e54bb64 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 11:52:59.613539 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:52:59.613539 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:52:59.613539 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:52:59.613539 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:52:59.613539 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:52:59.613539 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:52:59.613539 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:52:59.613539 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:52:59.613539 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:52:59.613539 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:52:59.613539 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:52:59.613539 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 11:52:59.613539 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 11:52:59.613539 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 11:52:59.614430 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 11:52:59.614430 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:52:59.614430 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:52:59.614430 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:52:59.614430 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:52:59.614430 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:52:59.614430 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:52:59.614430 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:52:59.614430 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:52:59.614430 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:52:59.614430 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:52:59.614430 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:52:59.614430 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:52:59.614430 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:52:59.614430 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:52:59.614430 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:52:59.614430 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:52:59.615319 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 11:52:59.615319 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 11:52:59.615319 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 11:52:59.615319 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 11:52:59.615319 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 11:52:59.615319 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 11:52:59.615319 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 11:52:59.615319 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:52:59.617789 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 351/688] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 25 11:52:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:52:59.625654 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af5f65-d043-41f9-85a5-a5a445f10216 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:59.654362 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:59.725006 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af5f65-d043-41f9-85a5-a5a445f10216 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:59.760805 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5637c6f-db30-4c58-a119-e097e0bbb430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:59.761487 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5637c6f-db30-4c58-a119-e097e0bbb430 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:59.761772 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5637c6f-db30-4c58-a119-e097e0bbb430 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:59.762053 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5637c6f-db30-4c58-a119-e097e0bbb430 None admin] PATH_INFO: `/v3/projects` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:59.762845 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5637c6f-db30-4c58-a119-e097e0bbb430 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:52:59.763162 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5637c6f-db30-4c58-a119-e097e0bbb430 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:59.764629 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5637c6f-db30-4c58-a119-e097e0bbb430 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:59.781879 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 338/689] 10.222.0.44 () {56 vars in 1148 bytes} [Wed May 25 11:52:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:52:59.787402 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c1101-e45e-4d9b-a1df-745c8e54bb64 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:52:59.893489 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:52:59.897484 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c1101-e45e-4d9b-a1df-745c8e54bb64 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:52:59.940248 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56afbb2b-d0af-4564-b2d8-9a5086f16855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:52:59.941151 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afbb2b-d0af-4564-b2d8-9a5086f16855 None admin] REQUEST_METHOD: `PUT` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:52:59.941561 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afbb2b-d0af-4564-b2d8-9a5086f16855 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:52:59.941848 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afbb2b-d0af-4564-b2d8-9a5086f16855 None admin] PATH_INFO: `/v3/projects/57e08d47948142978437098a8120be78/users/d25d7a439361492d8d7ba018531a2e7a/roles/2fe5c1214bcc4c1bafa5a4545161518d` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:52:59.943915 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56afbb2b-d0af-4564-b2d8-9a5086f16855 None admin] RBAC: Authorizing `identity:create_grant(project_id=57e08d47948142978437098a8120be78, user_id=d25d7a439361492d8d7ba018531a2e7a, role_id=2fe5c1214bcc4c1bafa5a4545161518d)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:52:59.945366 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56afbb2b-d0af-4564-b2d8-9a5086f16855 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:52:59.963701 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 352/690] 10.222.0.44 () {58 vars in 1439 bytes} [Wed May 25 11:52:59 2022] PUT /identity/v3/projects/57e08d47948142978437098a8120be78/users/d25d7a439361492d8d7ba018531a2e7a/roles/2fe5c1214bcc4c1bafa5a4545161518d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 11:53:00.409249 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad4900-919e-482a-a9ad-97555a195a0f None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:00.409644 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad4900-919e-482a-a9ad-97555a195a0f None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:00.409891 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad4900-919e-482a-a9ad-97555a195a0f None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:00.411406 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 339/691] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:53:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:53:00.416970 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556848e3-6eb0-48e6-8a6c-4e54ea780724 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:00.417261 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556848e3-6eb0-48e6-8a6c-4e54ea780724 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:00.417541 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556848e3-6eb0-48e6-8a6c-4e54ea780724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:00.434357 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-556848e3-6eb0-48e6-8a6c-4e54ea780724 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:53:00.435547 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-556848e3-6eb0-48e6-8a6c-4e54ea780724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:53:00.507903 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 353/692] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:53:00 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 11:53:00.528913 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ad4900-919e-482a-a9ad-97555a195a0f None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:00.622888 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:00.635631 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ad4900-919e-482a-a9ad-97555a195a0f None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:00.675993 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a6c47-97c5-413d-b560-4502f37393e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:00.677162 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a6c47-97c5-413d-b560-4502f37393e7 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:00.677680 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a6c47-97c5-413d-b560-4502f37393e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:00.678177 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a6c47-97c5-413d-b560-4502f37393e7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:00.679032 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a6c47-97c5-413d-b560-4502f37393e7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:00.680692 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a6c47-97c5-413d-b560-4502f37393e7 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:00.693794 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-031a6c47-97c5-413d-b560-4502f37393e7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 11:53:00.693794 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:53:00.693794 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 11:53:00.693794 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 11:53:00.693794 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 11:53:00.693794 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 11:53:00.693794 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 11:53:00.693794 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 11:53:00.693794 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 11:53:00.693794 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:53:00.693794 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 11:53:00.693794 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:53:00.693794 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:53:00.693794 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:53:00.693794 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:53:00.693794 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:53:00.694826 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:53:00.694826 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:53:00.694826 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:53:00.694826 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:53:00.694826 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:53:00.694826 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:53:00.694826 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:53:00.694826 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 11:53:00.694826 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 11:53:00.694826 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 11:53:00.694826 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 11:53:00.694826 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:53:00.694826 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:53:00.694826 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:53:00.694826 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:53:00.694826 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:53:00.695682 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:53:00.695682 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:53:00.695682 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:53:00.695682 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:53:00.695682 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:53:00.695682 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:53:00.695682 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:53:00.695682 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:53:00.695682 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:53:00.695682 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:53:00.695682 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:53:00.695682 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 11:53:00.695682 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 11:53:00.695682 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 11:53:00.695682 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:53:00.698589 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 340/693] 10.222.0.44 () {56 vars in 1129 bytes} [Wed May 25 11:53:00 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:53:00.705729 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556848e3-6eb0-48e6-8a6c-4e54ea780724 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:00.798711 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:00.812006 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556848e3-6eb0-48e6-8a6c-4e54ea780724 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:00.859020 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e48651-76ad-4e7e-b83e-fe2860d4bd7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:00.859695 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e48651-76ad-4e7e-b83e-fe2860d4bd7f None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:00.860012 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e48651-76ad-4e7e-b83e-fe2860d4bd7f None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:00.860294 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e48651-76ad-4e7e-b83e-fe2860d4bd7f None admin] PATH_INFO: `/v3/services` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:00.861147 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e48651-76ad-4e7e-b83e-fe2860d4bd7f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:53:00.861458 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e48651-76ad-4e7e-b83e-fe2860d4bd7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:00.862827 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e48651-76ad-4e7e-b83e-fe2860d4bd7f None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:00.868546 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 354/694] 10.222.0.44 () {56 vars in 1124 bytes} [Wed May 25 11:53:00 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:53:00.874350 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a6c47-97c5-413d-b560-4502f37393e7 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:00.986186 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a6c47-97c5-413d-b560-4502f37393e7 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:01.021653 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ae713-db93-4e59-aeaf-676559038236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:01.022322 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ae713-db93-4e59-aeaf-676559038236 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:01.022602 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ae713-db93-4e59-aeaf-676559038236 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:01.022875 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ae713-db93-4e59-aeaf-676559038236 None admin] PATH_INFO: `/v3/services` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:01.023572 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213ae713-db93-4e59-aeaf-676559038236 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:53:01.023914 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213ae713-db93-4e59-aeaf-676559038236 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:01.025823 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213ae713-db93-4e59-aeaf-676559038236 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:01.031616 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 341/695] 10.222.0.44 () {56 vars in 1124 bytes} [Wed May 25 11:53:00 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:53:01.037896 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e48651-76ad-4e7e-b83e-fe2860d4bd7f None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:01.107400 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1120871-74d9-464a-a3ef-1984ec3d6b2c None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:01.107773 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1120871-74d9-464a-a3ef-1984ec3d6b2c None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:01.108177 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1120871-74d9-464a-a3ef-1984ec3d6b2c None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:01.109884 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 342/696] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:53:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:53:01.115060 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a1252-ecad-498d-b627-e3aa6e029d5b None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:01.115441 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a1252-ecad-498d-b627-e3aa6e029d5b None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:01.115819 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a1252-ecad-498d-b627-e3aa6e029d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:01.132762 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-e28a1252-ecad-498d-b627-e3aa6e029d5b None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:53:01.134719 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-e28a1252-ecad-498d-b627-e3aa6e029d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:53:01.144782 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e48651-76ad-4e7e-b83e-fe2860d4bd7f None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:01.148947 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:01.186014 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7caff2d-1829-484c-9145-2fc7530e0544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:01.186853 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7caff2d-1829-484c-9145-2fc7530e0544 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:01.187280 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7caff2d-1829-484c-9145-2fc7530e0544 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:01.187696 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7caff2d-1829-484c-9145-2fc7530e0544 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:01.188748 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7caff2d-1829-484c-9145-2fc7530e0544 None admin] RBAC: Adding query filter params (interface=public, service_id=afdb53e998394d16956a5518fa2a3437, region_id=RegionOne) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:53:01.189207 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7caff2d-1829-484c-9145-2fc7530e0544 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:01.191345 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7caff2d-1829-484c-9145-2fc7530e0544 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:01.207896 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 355/697] 10.222.0.44 () {56 vars in 1251 bytes} [Wed May 25 11:53:01 2022] GET /identity/v3/endpoints?service_id=afdb53e998394d16956a5518fa2a3437&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:53:01.210111 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7caff2d-1829-484c-9145-2fc7530e0544 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:01.228154 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 343/698] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:53:01 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 11:53:01.231611 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:01.251042 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a1252-ecad-498d-b627-e3aa6e029d5b None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:01.344606 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7caff2d-1829-484c-9145-2fc7530e0544 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:01.375953 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a1252-ecad-498d-b627-e3aa6e029d5b None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:01.389790 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0734a07-27e2-4e1c-87e3-a511a8fae8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:01.391002 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0734a07-27e2-4e1c-87e3-a511a8fae8fc None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:01.391475 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0734a07-27e2-4e1c-87e3-a511a8fae8fc None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:01.392171 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0734a07-27e2-4e1c-87e3-a511a8fae8fc None admin] PATH_INFO: `/v3/services` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:01.393519 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0734a07-27e2-4e1c-87e3-a511a8fae8fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:01.395626 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0734a07-27e2-4e1c-87e3-a511a8fae8fc None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:01.403738 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 356/699] 10.222.0.44 () {56 vars in 1087 bytes} [Wed May 25 11:53:01 2022] GET /identity/v3/services => generated 1002 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 11:53:01.418986 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2264f7e1-91f5-42b6-a9b5-939b3d68e0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:01.419947 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264f7e1-91f5-42b6-a9b5-939b3d68e0a2 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:01.420301 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264f7e1-91f5-42b6-a9b5-939b3d68e0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:01.420644 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264f7e1-91f5-42b6-a9b5-939b3d68e0a2 None admin] PATH_INFO: `/v3/services/image` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:01.421390 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2264f7e1-91f5-42b6-a9b5-939b3d68e0a2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:01.422889 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2264f7e1-91f5-42b6-a9b5-939b3d68e0a2 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:01.436214 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-2264f7e1-91f5-42b6-a9b5-939b3d68e0a2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 25 11:53:01.436214 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:53:01.436214 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 11:53:01.436214 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 11:53:01.436214 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 11:53:01.436214 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 11:53:01.436214 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 11:53:01.436214 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 11:53:01.436214 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 11:53:01.436214 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:53:01.436214 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 11:53:01.436214 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:53:01.436214 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:53:01.436214 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:53:01.436214 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:53:01.436214 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:53:01.436214 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:53:01.437311 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:53:01.437311 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:53:01.437311 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:53:01.437311 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:53:01.437311 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:53:01.437311 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:53:01.437311 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 11:53:01.437311 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 11:53:01.437311 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 11:53:01.437311 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 11:53:01.437311 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:53:01.437311 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:53:01.437311 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:53:01.437311 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:53:01.437311 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:53:01.437311 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:53:01.438150 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:53:01.438150 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:53:01.438150 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:53:01.438150 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:53:01.438150 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:53:01.438150 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:53:01.438150 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:53:01.438150 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:53:01.438150 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:53:01.438150 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:53:01.438150 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 11:53:01.438150 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 11:53:01.438150 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 11:53:01.438150 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:53:01.438150 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 344/700] 10.222.0.44 () {56 vars in 1105 bytes} [Wed May 25 11:53:01 2022] GET /identity/v3/services/image => generated 86 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 11:53:01.447060 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0734a07-27e2-4e1c-87e3-a511a8fae8fc None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:01.509639 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe9d2a-4b0f-4878-9b7f-0496c4806840 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:01.509932 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe9d2a-4b0f-4878-9b7f-0496c4806840 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:01.510118 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe9d2a-4b0f-4878-9b7f-0496c4806840 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:01.511604 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 345/701] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:53:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:53:01.517176 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da500e-1ed4-478f-a1c2-432ce78637b3 None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:01.517469 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da500e-1ed4-478f-a1c2-432ce78637b3 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:01.517728 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da500e-1ed4-478f-a1c2-432ce78637b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:01.542559 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-75da500e-1ed4-478f-a1c2-432ce78637b3 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:53:01.543782 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-75da500e-1ed4-478f-a1c2-432ce78637b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:53:01.552015 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:01.556939 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:01.575127 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0734a07-27e2-4e1c-87e3-a511a8fae8fc None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:01.619329 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a16feb-43f4-4944-a1f2-442170347ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:01.620842 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a16feb-43f4-4944-a1f2-442170347ade None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:01.621127 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a16feb-43f4-4944-a1f2-442170347ade None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:01.621400 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a16feb-43f4-4944-a1f2-442170347ade None admin] PATH_INFO: `/v3/services` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:01.622103 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a16feb-43f4-4944-a1f2-442170347ade None admin] RBAC: Adding query filter params (name=image) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:53:01.622409 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a16feb-43f4-4944-a1f2-442170347ade None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:01.623769 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a16feb-43f4-4944-a1f2-442170347ade None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:01.629713 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 357/702] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:53:01 2022] GET /identity/v3/services?name=image => generated 122 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:53:01.635318 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a16feb-43f4-4944-a1f2-442170347ade None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:01.639448 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 346/703] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:53:01 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 11:53:01.663603 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da500e-1ed4-478f-a1c2-432ce78637b3 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:01.741727 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a16feb-43f4-4944-a1f2-442170347ade None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:01.783178 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383421cc-82d3-44fa-96d9-49eab9eb057d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:01.783589 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383421cc-82d3-44fa-96d9-49eab9eb057d None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:01.783898 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383421cc-82d3-44fa-96d9-49eab9eb057d None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:01.784178 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383421cc-82d3-44fa-96d9-49eab9eb057d None admin] PATH_INFO: `/v3/services` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:01.784877 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383421cc-82d3-44fa-96d9-49eab9eb057d None admin] RBAC: Adding query filter params (type=image) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:53:01.785191 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383421cc-82d3-44fa-96d9-49eab9eb057d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:01.786554 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383421cc-82d3-44fa-96d9-49eab9eb057d None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:01.787594 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da500e-1ed4-478f-a1c2-432ce78637b3 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:01.792458 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 358/704] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:53:01 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:53:01.799333 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383421cc-82d3-44fa-96d9-49eab9eb057d None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:01.815094 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:01.829502 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b539ba5b-deea-47cd-93ad-207ab6bab826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:01.830326 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b539ba5b-deea-47cd-93ad-207ab6bab826 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:01.830608 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b539ba5b-deea-47cd-93ad-207ab6bab826 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:01.830883 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b539ba5b-deea-47cd-93ad-207ab6bab826 None admin] PATH_INFO: `/v3/services/network` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:01.831540 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b539ba5b-deea-47cd-93ad-207ab6bab826 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:01.832949 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b539ba5b-deea-47cd-93ad-207ab6bab826 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:01.845405 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-b539ba5b-deea-47cd-93ad-207ab6bab826 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 25 11:53:01.845405 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:53:01.845405 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 11:53:01.845405 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 11:53:01.845405 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 11:53:01.845405 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 11:53:01.845405 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 11:53:01.845405 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 11:53:01.845405 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 11:53:01.845405 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:53:01.845405 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 11:53:01.845405 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:53:01.845405 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:53:01.845405 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:53:01.845405 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:53:01.845405 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:53:01.845405 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:53:01.846459 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:53:01.846459 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:53:01.846459 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:53:01.846459 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:53:01.846459 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:53:01.846459 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:53:01.846459 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 11:53:01.846459 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 11:53:01.846459 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 11:53:01.846459 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 11:53:01.846459 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:53:01.846459 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:53:01.846459 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:53:01.846459 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:53:01.846459 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:53:01.846459 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:53:01.847417 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:53:01.847417 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:53:01.847417 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:53:01.847417 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:53:01.847417 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:53:01.847417 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:53:01.847417 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:53:01.847417 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:53:01.847417 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:53:01.847417 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:53:01.847417 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 11:53:01.847417 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 11:53:01.847417 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 11:53:01.847417 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:53:01.852058 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 347/705] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 25 11:53:01 2022] GET /identity/v3/services/network => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:53:01.854484 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b539ba5b-deea-47cd-93ad-207ab6bab826 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:01.868688 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:01.936080 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383421cc-82d3-44fa-96d9-49eab9eb057d None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:01.972108 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9533a2-2a2c-42d3-9c3a-436445ccfe76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:01.972765 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9533a2-2a2c-42d3-9c3a-436445ccfe76 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:01.973052 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9533a2-2a2c-42d3-9c3a-436445ccfe76 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:01.973327 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9533a2-2a2c-42d3-9c3a-436445ccfe76 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:01.974161 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9533a2-2a2c-42d3-9c3a-436445ccfe76 None admin] RBAC: Adding query filter params (interface=public, service_id=b5ad556c49694b188050ac460fab4c75, region_id=RegionOne) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:53:01.974757 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9533a2-2a2c-42d3-9c3a-436445ccfe76 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:01.976176 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9533a2-2a2c-42d3-9c3a-436445ccfe76 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:01.986359 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 359/706] 10.222.0.44 () {56 vars in 1251 bytes} [Wed May 25 11:53:01 2022] GET /identity/v3/endpoints?service_id=b5ad556c49694b188050ac460fab4c75&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:53:01.987341 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9533a2-2a2c-42d3-9c3a-436445ccfe76 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:01.994802 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b539ba5b-deea-47cd-93ad-207ab6bab826 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:02.044132 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc722a-ac34-4f4a-9f8c-8473320ce90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:02.045327 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc722a-ac34-4f4a-9f8c-8473320ce90d None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:02.045776 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc722a-ac34-4f4a-9f8c-8473320ce90d None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:02.046480 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc722a-ac34-4f4a-9f8c-8473320ce90d None admin] PATH_INFO: `/v3/services` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:02.048114 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cc722a-ac34-4f4a-9f8c-8473320ce90d None admin] RBAC: Adding query filter params (name=network) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:53:02.048471 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cc722a-ac34-4f4a-9f8c-8473320ce90d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:02.049874 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cc722a-ac34-4f4a-9f8c-8473320ce90d None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:02.057962 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 348/707] 10.222.0.44 () {56 vars in 1112 bytes} [Wed May 25 11:53:01 2022] GET /identity/v3/services?name=network => generated 124 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:53:02.064511 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc722a-ac34-4f4a-9f8c-8473320ce90d None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:02.065198 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:02.107181 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9533a2-2a2c-42d3-9c3a-436445ccfe76 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:02.141564 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:02.160250 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c25578a-49fc-45d2-90b4-136c8f3096f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:02.160928 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c25578a-49fc-45d2-90b4-136c8f3096f4 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:02.161215 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c25578a-49fc-45d2-90b4-136c8f3096f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:02.161494 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c25578a-49fc-45d2-90b4-136c8f3096f4 None admin] PATH_INFO: `/v3/services` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:02.162578 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c25578a-49fc-45d2-90b4-136c8f3096f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:02.163982 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c25578a-49fc-45d2-90b4-136c8f3096f4 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:02.175947 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 360/708] 10.222.0.44 () {56 vars in 1087 bytes} [Wed May 25 11:53:01 2022] GET /identity/v3/services => generated 1002 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 11:53:02.189864 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc722a-ac34-4f4a-9f8c-8473320ce90d None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:02.231584 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed506006-5e81-4909-b41f-800c323e3e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:02.232708 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed506006-5e81-4909-b41f-800c323e3e56 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:02.233206 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed506006-5e81-4909-b41f-800c323e3e56 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:02.233786 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed506006-5e81-4909-b41f-800c323e3e56 None admin] PATH_INFO: `/v3/services` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:02.234824 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed506006-5e81-4909-b41f-800c323e3e56 None admin] RBAC: Adding query filter params (type=network) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:53:02.235365 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed506006-5e81-4909-b41f-800c323e3e56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:02.237080 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed506006-5e81-4909-b41f-800c323e3e56 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:02.243852 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 349/709] 10.222.0.44 () {56 vars in 1112 bytes} [Wed May 25 11:53:02 2022] GET /identity/v3/services?type=network => generated 350 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:53:02.251862 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c25578a-49fc-45d2-90b4-136c8f3096f4 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:02.361328 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c25578a-49fc-45d2-90b4-136c8f3096f4 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:02.400674 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ccc757-3d46-4825-a888-b4a2c14f4dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:02.401333 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ccc757-3d46-4825-a888-b4a2c14f4dcc None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:02.401613 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ccc757-3d46-4825-a888-b4a2c14f4dcc None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:02.401886 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ccc757-3d46-4825-a888-b4a2c14f4dcc None admin] PATH_INFO: `/v3/endpoints` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:02.402672 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ccc757-3d46-4825-a888-b4a2c14f4dcc None admin] RBAC: Adding query filter params (interface=public, service_id=73933edd33e64f22b6006827db4a66b5, region_id=RegionOne) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:53:02.402981 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ccc757-3d46-4825-a888-b4a2c14f4dcc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:02.404380 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ccc757-3d46-4825-a888-b4a2c14f4dcc None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:02.406846 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:02.411974 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 361/710] 10.222.0.44 () {56 vars in 1251 bytes} [Wed May 25 11:53:02 2022] GET /identity/v3/endpoints?service_id=73933edd33e64f22b6006827db4a66b5&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:53:02.416027 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed506006-5e81-4909-b41f-800c323e3e56 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:02.438291 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de8d69-077b-4f48-9743-d23cb0392eab None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:02.438598 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de8d69-077b-4f48-9743-d23cb0392eab None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:02.438855 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de8d69-077b-4f48-9743-d23cb0392eab None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:02.440770 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 362/711] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:53:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:53:02.445747 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5793cdf-6479-47ae-8275-cb13e7e8a1bf None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:02.446055 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5793cdf-6479-47ae-8275-cb13e7e8a1bf None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:02.446865 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5793cdf-6479-47ae-8275-cb13e7e8a1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:02.465344 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-a5793cdf-6479-47ae-8275-cb13e7e8a1bf None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:53:02.466763 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-a5793cdf-6479-47ae-8275-cb13e7e8a1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:53:02.541470 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed506006-5e81-4909-b41f-800c323e3e56 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:02.549707 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 363/712] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:53:02 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 11:53:02.576417 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5793cdf-6479-47ae-8275-cb13e7e8a1bf None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:02.582094 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8acadea-1979-4f2c-a7ab-6668358b366f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:02.582955 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8acadea-1979-4f2c-a7ab-6668358b366f None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:02.583394 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8acadea-1979-4f2c-a7ab-6668358b366f None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:02.583878 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8acadea-1979-4f2c-a7ab-6668358b366f None admin] PATH_INFO: `/v3/services` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:02.585237 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8acadea-1979-4f2c-a7ab-6668358b366f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:02.587309 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8acadea-1979-4f2c-a7ab-6668358b366f None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:02.589201 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:02.597378 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 350/713] 10.222.0.44 () {56 vars in 1087 bytes} [Wed May 25 11:53:02 2022] GET /identity/v3/services => generated 1002 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 11:53:02.696934 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5793cdf-6479-47ae-8275-cb13e7e8a1bf None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:02.728971 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:02.735591 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0547096-8aff-4a3f-a038-444ce9c0741a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:02.736623 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0547096-8aff-4a3f-a038-444ce9c0741a None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:02.737146 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0547096-8aff-4a3f-a038-444ce9c0741a None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:02.737422 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0547096-8aff-4a3f-a038-444ce9c0741a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:02.750061 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0547096-8aff-4a3f-a038-444ce9c0741a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:53:02.757907 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-e0547096-8aff-4a3f-a038-444ce9c0741a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 11:53:02.757907 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:53:02.757907 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:53:02.757907 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:53:02.757907 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:53:02.757907 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:53:02.757907 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:53:02.757907 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:53:02.757907 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:53:02.757907 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:53:02.757907 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:53:02.757907 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:53:02.757907 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:53:02.757907 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:53:02.757907 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:53:02.757907 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:53:02.758947 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:53:02.758947 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:53:02.758947 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:53:02.758947 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:53:02.758947 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:53:02.758947 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:53:02.758947 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:53:02.758947 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:53:02.758947 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:53:02.758947 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:53:02.758947 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:53:02.758947 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:53:02.758947 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:53:02.758947 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:53:02.758947 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:53:02.758947 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:53:02.759830 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:53:02.759830 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:53:02.759830 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:53:02.759830 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:53:02.759830 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:53:02.759830 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:53:02.759830 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:53:02.759830 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:53:02.759830 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:53:02.759830 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:53:02.759830 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 11:53:02.759830 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:53:02.760489 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 364/714] 10.222.0.44 () {56 vars in 1096 bytes} [Wed May 25 11:53:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 11:53:02.765727 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8acadea-1979-4f2c-a7ab-6668358b366f None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:02.877227 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8acadea-1979-4f2c-a7ab-6668358b366f None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:02.913155 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b5809-69e2-47eb-ade4-9c11c60762a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:02.913513 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b5809-69e2-47eb-ade4-9c11c60762a5 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:02.913809 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b5809-69e2-47eb-ade4-9c11c60762a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:02.914090 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b5809-69e2-47eb-ade4-9c11c60762a5 None admin] PATH_INFO: `/v3/roles` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:02.915364 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6b5809-69e2-47eb-ade4-9c11c60762a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:53:02.915676 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6b5809-69e2-47eb-ade4-9c11c60762a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:02.917136 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6b5809-69e2-47eb-ade4-9c11c60762a5 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:02.926425 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 351/715] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 25 11:53:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:53:02.936871 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0547096-8aff-4a3f-a038-444ce9c0741a None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:03.049098 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0547096-8aff-4a3f-a038-444ce9c0741a None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:03.083761 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9708a2e8-b0d1-418c-97c1-6e64ac580b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:03.084578 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708a2e8-b0d1-418c-97c1-6e64ac580b2a None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:03.084854 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708a2e8-b0d1-418c-97c1-6e64ac580b2a None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:03.085122 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708a2e8-b0d1-418c-97c1-6e64ac580b2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:03.096310 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9708a2e8-b0d1-418c-97c1-6e64ac580b2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:03.097764 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9708a2e8-b0d1-418c-97c1-6e64ac580b2a None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:03.115083 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-9708a2e8-b0d1-418c-97c1-6e64ac580b2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:53:03.115083 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:53:03.115083 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:53:03.115083 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:53:03.115083 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:53:03.115083 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:53:03.115083 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:53:03.115083 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:53:03.115083 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:53:03.115083 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:53:03.115083 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:53:03.115083 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:53:03.115083 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 11:53:03.115083 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 11:53:03.115083 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 11:53:03.116041 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 11:53:03.116041 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:53:03.116041 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:53:03.116041 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:53:03.116041 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:53:03.116041 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:53:03.116041 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:53:03.116041 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:53:03.116041 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:53:03.116041 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:53:03.116041 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:53:03.116041 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:53:03.116041 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:53:03.116041 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:53:03.116041 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:53:03.116041 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:53:03.116041 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:53:03.116915 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 11:53:03.116915 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 11:53:03.116915 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:53:03.116915 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:53:03.116915 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 365/716] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:53:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:53:03.123712 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b5809-69e2-47eb-ade4-9c11c60762a5 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:03.191111 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:03.239494 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b5809-69e2-47eb-ade4-9c11c60762a5 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:03.273763 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1e3068-92cc-4389-b263-46d6b17bd47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:03.274968 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e3068-92cc-4389-b263-46d6b17bd47f None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:03.275252 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e3068-92cc-4389-b263-46d6b17bd47f None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:03.275528 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e3068-92cc-4389-b263-46d6b17bd47f None admin] PATH_INFO: `/v3/domains` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:03.276279 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1e3068-92cc-4389-b263-46d6b17bd47f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:53:03.276591 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1e3068-92cc-4389-b263-46d6b17bd47f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:03.277964 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1e3068-92cc-4389-b263-46d6b17bd47f None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:03.290677 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 352/717] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 25 11:53:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:53:03.295912 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9708a2e8-b0d1-418c-97c1-6e64ac580b2a None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:03.344462 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:03.404779 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9708a2e8-b0d1-418c-97c1-6e64ac580b2a None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:03.439699 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c1d8f-d51c-4d17-8379-634841b3c2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:03.440520 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c1d8f-d51c-4d17-8379-634841b3c2ce None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:03.440858 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c1d8f-d51c-4d17-8379-634841b3c2ce None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:03.441135 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c1d8f-d51c-4d17-8379-634841b3c2ce None admin] PATH_INFO: `/v3/users/nova` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:03.449454 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64c1d8f-d51c-4d17-8379-634841b3c2ce None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:03.450897 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64c1d8f-d51c-4d17-8379-634841b3c2ce None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:03.465900 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-e64c1d8f-d51c-4d17-8379-634841b3c2ce None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 11:53:03.465900 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:53:03.465900 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:53:03.465900 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:53:03.465900 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:53:03.465900 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:53:03.465900 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:53:03.465900 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:53:03.465900 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:53:03.465900 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:53:03.465900 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:53:03.465900 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:53:03.465900 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 11:53:03.465900 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 11:53:03.465900 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 11:53:03.465900 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 11:53:03.466864 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:53:03.466864 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:53:03.466864 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 11:53:03.466864 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 11:53:03.466864 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 11:53:03.466864 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 11:53:03.466864 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:53:03.466864 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:53:03.466864 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:53:03.466864 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:53:03.466864 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:53:03.466864 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:53:03.466864 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:53:03.466864 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:53:03.466864 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:53:03.466864 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:53:03.466864 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:53:03.466864 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:53:03.467861 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:53:03.467861 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:53:03.467861 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 11:53:03.467861 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 11:53:03.467861 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 11:53:03.467861 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 11:53:03.467861 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 11:53:03.467861 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 11:53:03.467861 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 11:53:03.467861 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:53:03.467861 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 366/718] 10.222.0.44 () {56 vars in 1093 bytes} [Wed May 25 11:53:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:53:03.474682 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1e3068-92cc-4389-b263-46d6b17bd47f None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:03.582740 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1e3068-92cc-4389-b263-46d6b17bd47f None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:03.603444 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:03.618918 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c3cee-cefc-443c-bfe9-77c6f6f2afb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:03.619638 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c3cee-cefc-443c-bfe9-77c6f6f2afb9 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:03.619961 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c3cee-cefc-443c-bfe9-77c6f6f2afb9 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:03.620247 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c3cee-cefc-443c-bfe9-77c6f6f2afb9 None admin] PATH_INFO: `/v3/users` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:03.621115 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0c3cee-cefc-443c-bfe9-77c6f6f2afb9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:53:03.621431 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0c3cee-cefc-443c-bfe9-77c6f6f2afb9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:03.622923 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0c3cee-cefc-443c-bfe9-77c6f6f2afb9 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:03.644979 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 353/719] 10.222.0.44 () {56 vars in 1133 bytes} [Wed May 25 11:53:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:53:03.651445 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c1d8f-d51c-4d17-8379-634841b3c2ce None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:03.756420 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c1d8f-d51c-4d17-8379-634841b3c2ce None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:03.760102 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:03.795571 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfee4037-b21b-44b9-8670-5dc73c65153a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:03.796253 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee4037-b21b-44b9-8670-5dc73c65153a None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:03.796537 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee4037-b21b-44b9-8670-5dc73c65153a None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:03.796812 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee4037-b21b-44b9-8670-5dc73c65153a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:03.841462 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bcbdba-52bc-45a1-a1ab-4598b5f7709e None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:03.841805 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bcbdba-52bc-45a1-a1ab-4598b5f7709e None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:03.842042 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bcbdba-52bc-45a1-a1ab-4598b5f7709e None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:03.843407 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 354/720] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:53:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:53:03.848992 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c837cf2-6659-45af-bc8f-89e576f7e0f9 None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:03.851131 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c837cf2-6659-45af-bc8f-89e576f7e0f9 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:03.851131 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c837cf2-6659-45af-bc8f-89e576f7e0f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:03.869724 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-0c837cf2-6659-45af-bc8f-89e576f7e0f9 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:53:03.871009 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-0c837cf2-6659-45af-bc8f-89e576f7e0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:53:03.900563 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfee4037-b21b-44b9-8670-5dc73c65153a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:03.902070 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfee4037-b21b-44b9-8670-5dc73c65153a None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:03.967963 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 355/721] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:53:03 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 11:53:03.986428 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c837cf2-6659-45af-bc8f-89e576f7e0f9 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:04.025440 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 367/722] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 25 11:53:03 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 11:53:04.034222 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfee4037-b21b-44b9-8670-5dc73c65153a None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:04.034410 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:04.117627 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c837cf2-6659-45af-bc8f-89e576f7e0f9 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:04.130729 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:04.147872 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfee4037-b21b-44b9-8670-5dc73c65153a None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:04.171263 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf38460-b1c3-41cb-b46f-d939ded8b0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:04.172730 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf38460-b1c3-41cb-b46f-d939ded8b0ae None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:04.173013 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf38460-b1c3-41cb-b46f-d939ded8b0ae None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:04.173287 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf38460-b1c3-41cb-b46f-d939ded8b0ae None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:04.173939 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf38460-b1c3-41cb-b46f-d939ded8b0ae None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:04.175345 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf38460-b1c3-41cb-b46f-d939ded8b0ae None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:04.190187 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1abc60-24ab-478c-8530-da2c2b51a90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:04.191110 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1abc60-24ab-478c-8530-da2c2b51a90c None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:04.191486 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1abc60-24ab-478c-8530-da2c2b51a90c None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:04.191926 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1abc60-24ab-478c-8530-da2c2b51a90c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:04.192495 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-9bf38460-b1c3-41cb-b46f-d939ded8b0ae None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 11:53:04.192495 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:53:04.192495 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 11:53:04.192495 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 11:53:04.192495 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 11:53:04.192495 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 11:53:04.192495 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 11:53:04.192495 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 11:53:04.192495 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 11:53:04.192495 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:53:04.192495 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 11:53:04.192495 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:53:04.192495 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:53:04.192495 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:53:04.192495 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:53:04.192495 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:53:04.193598 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:53:04.193598 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:53:04.193598 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:53:04.193598 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:53:04.193598 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:53:04.193598 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:53:04.193598 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:53:04.193598 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 11:53:04.193598 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 11:53:04.193598 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 11:53:04.193598 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 11:53:04.193598 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:53:04.193598 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:53:04.193598 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:53:04.193598 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:53:04.193598 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:53:04.194450 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:53:04.194450 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:53:04.194450 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:53:04.194450 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:53:04.194450 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:53:04.194450 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:53:04.194450 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:53:04.194450 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:53:04.194450 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:53:04.194450 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:53:04.194450 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:53:04.194450 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 11:53:04.194450 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 11:53:04.194450 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 11:53:04.194450 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:53:04.198067 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 356/723] 10.222.0.44 () {56 vars in 1129 bytes} [Wed May 25 11:53:03 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 11:53:04.205325 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf38460-b1c3-41cb-b46f-d939ded8b0ae None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:04.209001 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1abc60-24ab-478c-8530-da2c2b51a90c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:04.211455 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1abc60-24ab-478c-8530-da2c2b51a90c None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:04.232652 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-5e1abc60-24ab-478c-8530-da2c2b51a90c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:53:04.232652 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:53:04.232652 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:53:04.232652 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:53:04.232652 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:53:04.232652 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:53:04.232652 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:53:04.232652 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:53:04.232652 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:53:04.232652 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:53:04.232652 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:53:04.232652 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:53:04.232652 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 11:53:04.232652 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 11:53:04.232652 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 11:53:04.233603 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 11:53:04.233603 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:53:04.233603 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:53:04.233603 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:53:04.233603 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:53:04.233603 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:53:04.233603 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:53:04.233603 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:53:04.233603 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:53:04.233603 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:53:04.233603 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:53:04.233603 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:53:04.233603 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:53:04.233603 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:53:04.233603 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:53:04.233603 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:53:04.233603 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:53:04.234503 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 11:53:04.234503 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 11:53:04.234503 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:53:04.234503 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:53:04.236995 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 368/724] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:53:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:53:04.244081 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1abc60-24ab-478c-8530-da2c2b51a90c None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:04.317580 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:04.325647 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf38460-b1c3-41cb-b46f-d939ded8b0ae None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:04.369620 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37246b0b-caa6-415a-8b6e-cd515d662306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:04.370733 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37246b0b-caa6-415a-8b6e-cd515d662306 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:04.371022 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37246b0b-caa6-415a-8b6e-cd515d662306 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:04.371302 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37246b0b-caa6-415a-8b6e-cd515d662306 None admin] PATH_INFO: `/v3/services` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:04.372313 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37246b0b-caa6-415a-8b6e-cd515d662306 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:53:04.372624 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37246b0b-caa6-415a-8b6e-cd515d662306 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:04.373998 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37246b0b-caa6-415a-8b6e-cd515d662306 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:04.374348 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1abc60-24ab-478c-8530-da2c2b51a90c None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:04.382828 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 357/725] 10.222.0.44 () {56 vars in 1124 bytes} [Wed May 25 11:53:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:53:04.386163 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37246b0b-caa6-415a-8b6e-cd515d662306 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:04.427843 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:04.428891 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5439fb-5a76-43b5-bf27-cbf235982481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:04.430429 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5439fb-5a76-43b5-bf27-cbf235982481 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:04.431058 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5439fb-5a76-43b5-bf27-cbf235982481 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:04.431544 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5439fb-5a76-43b5-bf27-cbf235982481 None admin] PATH_INFO: `/v3/domains` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:04.432520 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5439fb-5a76-43b5-bf27-cbf235982481 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:53:04.433062 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5439fb-5a76-43b5-bf27-cbf235982481 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:04.436121 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5439fb-5a76-43b5-bf27-cbf235982481 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:04.456824 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 369/726] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 25 11:53:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:53:04.457862 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5439fb-5a76-43b5-bf27-cbf235982481 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:04.505150 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37246b0b-caa6-415a-8b6e-cd515d662306 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:04.552775 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28775bf-3d27-4ce6-bbe5-799ad220aa86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:04.554136 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28775bf-3d27-4ce6-bbe5-799ad220aa86 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:04.554856 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28775bf-3d27-4ce6-bbe5-799ad220aa86 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:04.555976 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28775bf-3d27-4ce6-bbe5-799ad220aa86 None admin] PATH_INFO: `/v3/services` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:04.557039 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28775bf-3d27-4ce6-bbe5-799ad220aa86 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:53:04.557560 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28775bf-3d27-4ce6-bbe5-799ad220aa86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:04.559735 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28775bf-3d27-4ce6-bbe5-799ad220aa86 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:04.566672 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 358/727] 10.222.0.44 () {56 vars in 1124 bytes} [Wed May 25 11:53:04 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:53:04.573133 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28775bf-3d27-4ce6-bbe5-799ad220aa86 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:04.582491 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5439fb-5a76-43b5-bf27-cbf235982481 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:04.597743 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:04.621410 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acf926b-154b-415b-8a8d-9b06b16770d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:04.622242 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf926b-154b-415b-8a8d-9b06b16770d6 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:04.622528 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf926b-154b-415b-8a8d-9b06b16770d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:04.622806 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf926b-154b-415b-8a8d-9b06b16770d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:04.630959 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acf926b-154b-415b-8a8d-9b06b16770d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:04.632440 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acf926b-154b-415b-8a8d-9b06b16770d6 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:04.648890 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-9acf926b-154b-415b-8a8d-9b06b16770d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 11:53:04.648890 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:53:04.648890 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:53:04.648890 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:53:04.648890 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:53:04.648890 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:53:04.648890 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:53:04.648890 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:53:04.648890 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:53:04.648890 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:53:04.648890 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:53:04.648890 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:53:04.648890 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 11:53:04.648890 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 11:53:04.648890 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 11:53:04.649834 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 11:53:04.649834 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:53:04.649834 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:53:04.649834 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:53:04.649834 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:53:04.649834 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:53:04.649834 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:53:04.649834 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:53:04.649834 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:53:04.649834 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:53:04.649834 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:53:04.649834 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:53:04.649834 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:53:04.649834 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:53:04.649834 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:53:04.649834 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:53:04.649834 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:53:04.655931 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 11:53:04.655931 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 11:53:04.655931 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 11:53:04.655931 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 11:53:04.655931 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 11:53:04.655931 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 11:53:04.655931 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 11:53:04.655931 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:53:04.655931 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 370/728] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 25 11:53:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:53:04.655931 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2680e-36a9-48ca-ba60-a152e07908b6 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:04.655931 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2680e-36a9-48ca-ba60-a152e07908b6 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:04.656547 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2680e-36a9-48ca-ba60-a152e07908b6 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:04.656547 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 371/729] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:53:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:53:04.657761 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a2680e-36a9-48ca-ba60-a152e07908b6 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:04.692717 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:04.697150 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28775bf-3d27-4ce6-bbe5-799ad220aa86 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:04.734180 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afa9572-f20a-4bb7-b44e-0ec66835e1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:04.734840 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa9572-f20a-4bb7-b44e-0ec66835e1d3 None admin] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:04.735208 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa9572-f20a-4bb7-b44e-0ec66835e1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:04.735390 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa9572-f20a-4bb7-b44e-0ec66835e1d3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:04.736157 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afa9572-f20a-4bb7-b44e-0ec66835e1d3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:04.737513 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afa9572-f20a-4bb7-b44e-0ec66835e1d3 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:04.757612 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 359/730] 10.222.0.44 () {60 vars in 1144 bytes} [Wed May 25 11:53:04 2022] POST /identity/v3/endpoints => generated 346 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 11:53:04.758820 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195d06f-3162-4dfd-8ea2-4d6a29b83d94 None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:04.759182 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195d06f-3162-4dfd-8ea2-4d6a29b83d94 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:04.759464 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195d06f-3162-4dfd-8ea2-4d6a29b83d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:04.779626 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-0195d06f-3162-4dfd-8ea2-4d6a29b83d94 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:53:04.780907 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-0195d06f-3162-4dfd-8ea2-4d6a29b83d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:53:04.792186 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a2680e-36a9-48ca-ba60-a152e07908b6 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:04.848065 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db999fe9-00bc-4228-99ca-1bf61b3c49bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:04.849721 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db999fe9-00bc-4228-99ca-1bf61b3c49bb None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:04.850553 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db999fe9-00bc-4228-99ca-1bf61b3c49bb None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:04.851035 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db999fe9-00bc-4228-99ca-1bf61b3c49bb None admin] PATH_INFO: `/v3/projects` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:04.852375 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db999fe9-00bc-4228-99ca-1bf61b3c49bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:53:04.853377 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db999fe9-00bc-4228-99ca-1bf61b3c49bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:04.855604 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db999fe9-00bc-4228-99ca-1bf61b3c49bb None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:04.864720 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 360/731] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:53:04 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 11:53:04.877527 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 372/732] 10.222.0.44 () {56 vars in 1148 bytes} [Wed May 25 11:53:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:53:04.878889 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0195d06f-3162-4dfd-8ea2-4d6a29b83d94 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:04.889217 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db999fe9-00bc-4228-99ca-1bf61b3c49bb None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:04.936081 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:05.005574 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:05.026475 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0195d06f-3162-4dfd-8ea2-4d6a29b83d94 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:05.039872 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db999fe9-00bc-4228-99ca-1bf61b3c49bb None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:05.063761 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37133e56-0e92-45e5-ad54-0459236db663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:05.064451 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37133e56-0e92-45e5-ad54-0459236db663 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:05.064732 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37133e56-0e92-45e5-ad54-0459236db663 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:05.065014 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37133e56-0e92-45e5-ad54-0459236db663 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:05.065835 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37133e56-0e92-45e5-ad54-0459236db663 None admin] RBAC: Adding query filter params (role.id=2fe5c1214bcc4c1bafa5a4545161518d, scope.project.id=57e08d47948142978437098a8120be78, user.id=d25d7a439361492d8d7ba018531a2e7a) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:53:05.066144 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37133e56-0e92-45e5-ad54-0459236db663 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:05.067622 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37133e56-0e92-45e5-ad54-0459236db663 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:05.074033 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 361/733] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 25 11:53:04 2022] GET /identity/v3/role_assignments?user.id=d25d7a439361492d8d7ba018531a2e7a&scope.project.id=57e08d47948142978437098a8120be78&role.id=2fe5c1214bcc4c1bafa5a4545161518d => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:53:05.075246 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfffdae-cfc2-4bde-8f2e-03112aa3af18 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:05.075538 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfffdae-cfc2-4bde-8f2e-03112aa3af18 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:05.075831 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfffdae-cfc2-4bde-8f2e-03112aa3af18 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:05.079856 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 362/734] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:53:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:53:05.083090 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779d3d7-93eb-475d-9aa1-20ea77e115f6 None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:05.084208 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779d3d7-93eb-475d-9aa1-20ea77e115f6 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:05.084561 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779d3d7-93eb-475d-9aa1-20ea77e115f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:05.085071 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b52ce56-5587-4602-8d42-524e124d286c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:05.086082 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52ce56-5587-4602-8d42-524e124d286c None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:05.086582 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52ce56-5587-4602-8d42-524e124d286c None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:05.087082 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b52ce56-5587-4602-8d42-524e124d286c None admin] PATH_INFO: `/v3/services/image` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:05.087998 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b52ce56-5587-4602-8d42-524e124d286c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:05.089596 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b52ce56-5587-4602-8d42-524e124d286c None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:05.104398 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-e779d3d7-93eb-475d-9aa1-20ea77e115f6 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:53:05.105921 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-e779d3d7-93eb-475d-9aa1-20ea77e115f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:53:05.107261 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-2b52ce56-5587-4602-8d42-524e124d286c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 25 11:53:05.107261 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:53:05.107261 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 11:53:05.107261 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 11:53:05.107261 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 11:53:05.107261 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 11:53:05.107261 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 11:53:05.107261 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 11:53:05.107261 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 11:53:05.107261 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:53:05.107261 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 11:53:05.107261 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:53:05.107261 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:53:05.107261 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:53:05.107261 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:53:05.107261 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:53:05.107261 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:53:05.108530 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:53:05.108530 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:53:05.108530 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:53:05.108530 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:53:05.108530 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:53:05.108530 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:53:05.108530 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 11:53:05.108530 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 11:53:05.108530 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 11:53:05.108530 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 11:53:05.108530 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:53:05.108530 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:53:05.108530 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:53:05.108530 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:53:05.108530 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:53:05.108530 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:53:05.115736 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:53:05.115736 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:53:05.115736 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:53:05.115736 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:53:05.115736 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:53:05.115736 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:53:05.115736 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:53:05.115736 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:53:05.115736 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:53:05.115736 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:53:05.115736 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 11:53:05.115736 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 11:53:05.115736 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 11:53:05.115736 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:53:05.115736 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 373/735] 10.222.0.44 () {56 vars in 1105 bytes} [Wed May 25 11:53:04 2022] GET /identity/v3/services/image => generated 86 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:53:05.117165 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b52ce56-5587-4602-8d42-524e124d286c None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:05.207614 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 363/736] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:53:05 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 11:53:05.231772 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e779d3d7-93eb-475d-9aa1-20ea77e115f6 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:05.248033 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:05.259195 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b52ce56-5587-4602-8d42-524e124d286c None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:05.303120 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e349e-f827-4451-9442-365afc7535aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:05.304155 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e349e-f827-4451-9442-365afc7535aa None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:05.304614 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e349e-f827-4451-9442-365afc7535aa None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:05.305069 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e349e-f827-4451-9442-365afc7535aa None admin] PATH_INFO: `/v3/services` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:05.306312 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9e349e-f827-4451-9442-365afc7535aa None admin] RBAC: Adding query filter params (name=image) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:53:05.306619 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9e349e-f827-4451-9442-365afc7535aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:05.308092 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9e349e-f827-4451-9442-365afc7535aa None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:05.316388 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 374/737] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:53:05 2022] GET /identity/v3/services?name=image => generated 122 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:53:05.321401 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e349e-f827-4451-9442-365afc7535aa None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:05.328463 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:05.353049 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e779d3d7-93eb-475d-9aa1-20ea77e115f6 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:05.391055 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ed961-9533-46fe-8dfe-6a5778b141db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:05.391887 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ed961-9533-46fe-8dfe-6a5778b141db None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:05.392174 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ed961-9533-46fe-8dfe-6a5778b141db None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:05.392452 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ed961-9533-46fe-8dfe-6a5778b141db None admin] PATH_INFO: `/v3/services/network` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:05.393111 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ed961-9533-46fe-8dfe-6a5778b141db None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:05.394481 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ed961-9533-46fe-8dfe-6a5778b141db None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:05.409486 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-4c1ed961-9533-46fe-8dfe-6a5778b141db None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 25 11:53:05.409486 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:53:05.409486 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 11:53:05.409486 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 11:53:05.409486 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 11:53:05.409486 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 11:53:05.409486 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 11:53:05.409486 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 11:53:05.409486 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 11:53:05.409486 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:53:05.409486 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 11:53:05.409486 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:53:05.409486 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:53:05.409486 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:53:05.409486 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:53:05.409486 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:53:05.409486 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:53:05.410506 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:53:05.410506 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:53:05.410506 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:53:05.410506 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:53:05.410506 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:53:05.410506 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:53:05.410506 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 11:53:05.410506 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 11:53:05.410506 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 11:53:05.410506 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 11:53:05.410506 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:53:05.410506 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:53:05.410506 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:53:05.410506 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:53:05.410506 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:53:05.410506 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:53:05.411379 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:53:05.411379 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:53:05.411379 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:53:05.411379 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:53:05.411379 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:53:05.411379 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:53:05.411379 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:53:05.411379 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:53:05.411379 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:53:05.411379 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:53:05.411379 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 11:53:05.411379 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 11:53:05.411379 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 11:53:05.411379 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:53:05.411379 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 364/738] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 25 11:53:05 2022] GET /identity/v3/services/network => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:53:05.418395 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ed961-9533-46fe-8dfe-6a5778b141db None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:05.452177 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e349e-f827-4451-9442-365afc7535aa None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:05.489076 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16991457-0b1a-4379-973d-2eea641ad94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:05.489661 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16991457-0b1a-4379-973d-2eea641ad94a None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:05.489945 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16991457-0b1a-4379-973d-2eea641ad94a None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:05.490220 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16991457-0b1a-4379-973d-2eea641ad94a None admin] PATH_INFO: `/v3/services` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:05.491039 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16991457-0b1a-4379-973d-2eea641ad94a None admin] RBAC: Adding query filter params (type=image) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:53:05.491461 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16991457-0b1a-4379-973d-2eea641ad94a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:05.492901 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16991457-0b1a-4379-973d-2eea641ad94a None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:05.498559 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 375/739] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:53:05 2022] GET /identity/v3/services?type=image => generated 350 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:53:05.504909 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16991457-0b1a-4379-973d-2eea641ad94a None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:05.527479 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ed961-9533-46fe-8dfe-6a5778b141db None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:05.537854 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:05.564142 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb71df-2987-40d4-9b9f-dbf6ba3e0f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:05.564816 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb71df-2987-40d4-9b9f-dbf6ba3e0f95 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:05.565099 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb71df-2987-40d4-9b9f-dbf6ba3e0f95 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:05.565377 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb71df-2987-40d4-9b9f-dbf6ba3e0f95 None admin] PATH_INFO: `/v3/services` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:05.566085 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bb71df-2987-40d4-9b9f-dbf6ba3e0f95 None admin] RBAC: Adding query filter params (name=network) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:53:05.566395 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bb71df-2987-40d4-9b9f-dbf6ba3e0f95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:05.567780 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bb71df-2987-40d4-9b9f-dbf6ba3e0f95 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:05.578087 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 365/740] 10.222.0.44 () {56 vars in 1112 bytes} [Wed May 25 11:53:05 2022] GET /identity/v3/services?name=network => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:53:05.579179 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb71df-2987-40d4-9b9f-dbf6ba3e0f95 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:05.593685 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:05.645884 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16991457-0b1a-4379-973d-2eea641ad94a None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:05.731237 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb71df-2987-40d4-9b9f-dbf6ba3e0f95 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:05.745408 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db851b68-7525-4fca-b799-b6d9002aad83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:05.746109 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db851b68-7525-4fca-b799-b6d9002aad83 None admin] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:05.746399 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db851b68-7525-4fca-b799-b6d9002aad83 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:05.746679 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db851b68-7525-4fca-b799-b6d9002aad83 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:05.747431 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db851b68-7525-4fca-b799-b6d9002aad83 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:05.754242 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db851b68-7525-4fca-b799-b6d9002aad83 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:05.788673 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571591fb-30b8-4cb9-b7d4-18c11b34f3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:05.789360 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571591fb-30b8-4cb9-b7d4-18c11b34f3e3 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:05.789768 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571591fb-30b8-4cb9-b7d4-18c11b34f3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:05.790102 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571591fb-30b8-4cb9-b7d4-18c11b34f3e3 None admin] PATH_INFO: `/v3/services` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:05.790869 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571591fb-30b8-4cb9-b7d4-18c11b34f3e3 None admin] RBAC: Adding query filter params (type=network) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:53:05.791218 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571591fb-30b8-4cb9-b7d4-18c11b34f3e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:05.792754 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571591fb-30b8-4cb9-b7d4-18c11b34f3e3 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:05.803756 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 376/741] 10.222.0.44 () {60 vars in 1144 bytes} [Wed May 25 11:53:05 2022] POST /identity/v3/endpoints => generated 327 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 11:53:05.818120 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 366/742] 10.222.0.44 () {56 vars in 1112 bytes} [Wed May 25 11:53:05 2022] GET /identity/v3/services?type=network => generated 350 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:53:05.826908 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db851b68-7525-4fca-b799-b6d9002aad83 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:05.938241 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:05.971711 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db851b68-7525-4fca-b799-b6d9002aad83 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:06.012474 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37aa46a-809d-430d-b0ed-e4762c296449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:06.013135 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37aa46a-809d-430d-b0ed-e4762c296449 None admin] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:06.013472 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37aa46a-809d-430d-b0ed-e4762c296449 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:06.013759 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37aa46a-809d-430d-b0ed-e4762c296449 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:06.014524 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37aa46a-809d-430d-b0ed-e4762c296449 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:06.015919 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37aa46a-809d-430d-b0ed-e4762c296449 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:06.040393 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 377/743] 10.222.0.44 () {60 vars in 1144 bytes} [Wed May 25 11:53:05 2022] POST /identity/v3/endpoints => generated 327 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 11:53:07.178770 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8feb07-6220-4624-bb7d-f64973d35b9f None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:07.179334 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8feb07-6220-4624-bb7d-f64973d35b9f None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:07.179334 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8feb07-6220-4624-bb7d-f64973d35b9f None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:07.181657 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 367/744] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:53:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:53:07.187008 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356ce3b-0040-4a8b-be39-d2aea24a86cc None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:07.187437 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356ce3b-0040-4a8b-be39-d2aea24a86cc None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:07.187604 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356ce3b-0040-4a8b-be39-d2aea24a86cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:07.204256 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-c356ce3b-0040-4a8b-be39-d2aea24a86cc None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:53:07.205448 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-c356ce3b-0040-4a8b-be39-d2aea24a86cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:53:07.278635 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 378/745] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:53:07 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 11:53:07.300898 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8feb07-6220-4624-bb7d-f64973d35b9f None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:07.371571 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:07.405899 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8feb07-6220-4624-bb7d-f64973d35b9f None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:07.441555 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24941fb-e61a-4c35-bef7-b951d4bf0094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:07.442270 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24941fb-e61a-4c35-bef7-b951d4bf0094 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:07.442547 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24941fb-e61a-4c35-bef7-b951d4bf0094 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:07.442814 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24941fb-e61a-4c35-bef7-b951d4bf0094 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:07.443448 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24941fb-e61a-4c35-bef7-b951d4bf0094 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:07.444848 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24941fb-e61a-4c35-bef7-b951d4bf0094 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:07.457054 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-e24941fb-e61a-4c35-bef7-b951d4bf0094 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 11:53:07.457054 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:53:07.457054 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 11:53:07.457054 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 11:53:07.457054 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 11:53:07.457054 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 11:53:07.457054 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 11:53:07.457054 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 11:53:07.457054 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 11:53:07.457054 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:53:07.457054 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 11:53:07.457054 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:53:07.457054 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:53:07.457054 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:53:07.457054 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:53:07.457054 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:53:07.457054 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:53:07.458034 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:53:07.458034 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:53:07.458034 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:53:07.458034 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:53:07.458034 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:53:07.458034 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:53:07.458034 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 11:53:07.458034 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 11:53:07.458034 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 11:53:07.458034 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 11:53:07.458034 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:53:07.458034 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:53:07.458034 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:53:07.458034 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:53:07.458034 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:53:07.458034 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:53:07.458887 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:53:07.458887 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:53:07.458887 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:53:07.458887 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:53:07.458887 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:53:07.458887 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:53:07.458887 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:53:07.458887 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:53:07.458887 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:53:07.458887 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:53:07.458887 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 11:53:07.458887 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 11:53:07.458887 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 11:53:07.458887 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:53:07.458887 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 368/746] 10.222.0.44 () {56 vars in 1114 bytes} [Wed May 25 11:53:07 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:53:07.465381 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356ce3b-0040-4a8b-be39-d2aea24a86cc None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:07.521393 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:07.566761 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356ce3b-0040-4a8b-be39-d2aea24a86cc None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:07.599485 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530cfc35-c97a-4de8-b878-7f499b636865 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:07.599782 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530cfc35-c97a-4de8-b878-7f499b636865 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:07.600098 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530cfc35-c97a-4de8-b878-7f499b636865 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:07.603843 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 369/747] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:53:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 11:53:07.604132 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3058fda6-cb7d-493d-9fd5-3645ef1e440f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:07.604132 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058fda6-cb7d-493d-9fd5-3645ef1e440f None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:07.604132 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058fda6-cb7d-493d-9fd5-3645ef1e440f None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:07.604132 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058fda6-cb7d-493d-9fd5-3645ef1e440f None admin] PATH_INFO: `/v3/services` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:07.605976 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3058fda6-cb7d-493d-9fd5-3645ef1e440f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:53:07.605976 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3058fda6-cb7d-493d-9fd5-3645ef1e440f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:07.606344 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3058fda6-cb7d-493d-9fd5-3645ef1e440f None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:07.607514 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ddb16-bf79-4bb3-a69c-3c69cf004e2e None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:07.607972 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ddb16-bf79-4bb3-a69c-3c69cf004e2e None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:07.608298 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ddb16-bf79-4bb3-a69c-3c69cf004e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:07.613094 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 379/748] 10.222.0.44 () {56 vars in 1114 bytes} [Wed May 25 11:53:07 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:53:07.619709 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3058fda6-cb7d-493d-9fd5-3645ef1e440f None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:07.635473 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-ba2ddb16-bf79-4bb3-a69c-3c69cf004e2e None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:53:07.636709 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-ba2ddb16-bf79-4bb3-a69c-3c69cf004e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:53:07.719880 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 370/749] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:53:07 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 11:53:07.732969 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3058fda6-cb7d-493d-9fd5-3645ef1e440f None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:07.738574 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ddb16-bf79-4bb3-a69c-3c69cf004e2e None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:07.756033 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:07.772330 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e3dc73-682f-4a65-b110-ee896b8f973e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:07.772995 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e3dc73-682f-4a65-b110-ee896b8f973e None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:07.773279 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e3dc73-682f-4a65-b110-ee896b8f973e None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:07.774718 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e3dc73-682f-4a65-b110-ee896b8f973e None admin] PATH_INFO: `/v3/services` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:07.774902 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e3dc73-682f-4a65-b110-ee896b8f973e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:53:07.775192 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e3dc73-682f-4a65-b110-ee896b8f973e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:07.776856 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e3dc73-682f-4a65-b110-ee896b8f973e None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:07.791886 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 380/750] 10.222.0.44 () {56 vars in 1114 bytes} [Wed May 25 11:53:07 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:53:07.824483 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:07.875260 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ddb16-bf79-4bb3-a69c-3c69cf004e2e None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:07.912784 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b5805a-5422-44dc-a3eb-36cfc2c77664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:07.913622 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5805a-5422-44dc-a3eb-36cfc2c77664 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:07.913907 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5805a-5422-44dc-a3eb-36cfc2c77664 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:07.914185 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5805a-5422-44dc-a3eb-36cfc2c77664 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:07.914881 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b5805a-5422-44dc-a3eb-36cfc2c77664 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:07.916322 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b5805a-5422-44dc-a3eb-36cfc2c77664 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:07.929670 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-b1b5805a-5422-44dc-a3eb-36cfc2c77664 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 11:53:07.929670 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:53:07.929670 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 11:53:07.929670 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 11:53:07.929670 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 11:53:07.929670 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 11:53:07.929670 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 11:53:07.929670 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 11:53:07.929670 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 11:53:07.929670 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:53:07.929670 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 11:53:07.929670 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:53:07.929670 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:53:07.929670 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:53:07.929670 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:53:07.929670 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:53:07.930687 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:53:07.930687 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:53:07.930687 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:53:07.930687 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:53:07.930687 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:53:07.930687 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:53:07.930687 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:53:07.930687 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 11:53:07.930687 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 11:53:07.930687 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 11:53:07.930687 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 11:53:07.930687 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:53:07.930687 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:53:07.930687 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:53:07.930687 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:53:07.930687 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:53:07.931787 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:53:07.931787 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:53:07.931787 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:53:07.931787 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:53:07.931787 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:53:07.931787 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:53:07.931787 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:53:07.931787 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:53:07.931787 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:53:07.931787 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:53:07.931787 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:53:07.931787 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 11:53:07.931787 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 11:53:07.931787 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 11:53:07.931787 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:53:07.931787 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 371/751] 10.222.0.44 () {56 vars in 1132 bytes} [Wed May 25 11:53:07 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 11:53:07.938395 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e3dc73-682f-4a65-b110-ee896b8f973e None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:08.045865 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e3dc73-682f-4a65-b110-ee896b8f973e None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:08.079696 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ecacd-8cee-4f28-9ad0-85cf8c2e3067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:08.080379 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ecacd-8cee-4f28-9ad0-85cf8c2e3067 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:08.080663 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ecacd-8cee-4f28-9ad0-85cf8c2e3067 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:08.080938 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ecacd-8cee-4f28-9ad0-85cf8c2e3067 None admin] PATH_INFO: `/v3/services` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:08.081636 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6ecacd-8cee-4f28-9ad0-85cf8c2e3067 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:53:08.081939 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6ecacd-8cee-4f28-9ad0-85cf8c2e3067 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:08.083312 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6ecacd-8cee-4f28-9ad0-85cf8c2e3067 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:08.088872 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 381/752] 10.222.0.44 () {56 vars in 1126 bytes} [Wed May 25 11:53:07 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:53:08.094756 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b5805a-5422-44dc-a3eb-36cfc2c77664 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:08.219165 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b5805a-5422-44dc-a3eb-36cfc2c77664 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:08.248300 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:08.254965 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a8104d-3043-41b6-9ed6-af07f4fe2ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:08.255848 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8104d-3043-41b6-9ed6-af07f4fe2ffe None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:08.256279 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8104d-3043-41b6-9ed6-af07f4fe2ffe None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:08.256701 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8104d-3043-41b6-9ed6-af07f4fe2ffe None admin] PATH_INFO: `/v3/services` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:08.257568 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a8104d-3043-41b6-9ed6-af07f4fe2ffe None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:53:08.258023 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a8104d-3043-41b6-9ed6-af07f4fe2ffe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:08.259568 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a8104d-3043-41b6-9ed6-af07f4fe2ffe None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:08.264273 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 372/753] 10.222.0.44 () {56 vars in 1126 bytes} [Wed May 25 11:53:08 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:53:08.309238 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896d28a-e9bf-43a9-89fb-80aa08234897 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:08.309761 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896d28a-e9bf-43a9-89fb-80aa08234897 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:08.309761 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896d28a-e9bf-43a9-89fb-80aa08234897 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:08.311340 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 382/754] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:53:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:53:08.316733 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedee22b-b346-44b7-b68f-bbef7875eb52 None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:08.317033 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedee22b-b346-44b7-b68f-bbef7875eb52 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:08.317317 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedee22b-b346-44b7-b68f-bbef7875eb52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:08.335287 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-aedee22b-b346-44b7-b68f-bbef7875eb52 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:53:08.337078 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-aedee22b-b346-44b7-b68f-bbef7875eb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:53:08.408693 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 373/755] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:53:08 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 11:53:08.432118 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896d28a-e9bf-43a9-89fb-80aa08234897 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:08.487380 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:08.541086 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896d28a-e9bf-43a9-89fb-80aa08234897 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:08.575298 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a4060b-0a0b-40fb-ab7c-5e148853bd10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:08.575897 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4060b-0a0b-40fb-ab7c-5e148853bd10 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:08.576185 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4060b-0a0b-40fb-ab7c-5e148853bd10 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:08.576461 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4060b-0a0b-40fb-ab7c-5e148853bd10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:08.643085 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a4060b-0a0b-40fb-ab7c-5e148853bd10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:08.644565 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a4060b-0a0b-40fb-ab7c-5e148853bd10 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:08.690451 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:08.741630 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 383/756] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 25 11:53:08 2022] GET /identity/v3/auth/tokens => generated 1396 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 25 11:53:08.747086 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedee22b-b346-44b7-b68f-bbef7875eb52 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:08.850149 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedee22b-b346-44b7-b68f-bbef7875eb52 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:08.875482 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:08.887068 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf02265-6d6e-4d8d-b165-a592429c5bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:08.887890 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf02265-6d6e-4d8d-b165-a592429c5bef None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:08.888199 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf02265-6d6e-4d8d-b165-a592429c5bef None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:08.888477 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf02265-6d6e-4d8d-b165-a592429c5bef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:08.898564 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf02265-6d6e-4d8d-b165-a592429c5bef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:08.900069 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf02265-6d6e-4d8d-b165-a592429c5bef None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:08.918435 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-6bf02265-6d6e-4d8d-b165-a592429c5bef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:53:08.918435 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:53:08.918435 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:53:08.918435 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:53:08.918435 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:53:08.918435 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:53:08.918435 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:53:08.918435 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:53:08.918435 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:53:08.918435 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:53:08.918435 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:53:08.918435 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:53:08.918435 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 11:53:08.918435 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 11:53:08.918435 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 11:53:08.919407 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 11:53:08.919407 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:53:08.919407 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:53:08.919407 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:53:08.919407 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:53:08.919407 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:53:08.919407 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:53:08.919407 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:53:08.919407 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:53:08.919407 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:53:08.919407 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:53:08.919407 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:53:08.919407 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:53:08.919407 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:53:08.919407 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:53:08.919407 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:53:08.919407 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:53:08.920728 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 11:53:08.920728 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 11:53:08.920728 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:53:08.920728 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:53:08.924145 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 374/757] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:53:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:53:08.926877 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a4060b-0a0b-40fb-ab7c-5e148853bd10 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:09.033105 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a4060b-0a0b-40fb-ab7c-5e148853bd10 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:09.067395 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ffa3df-f813-45df-a9fc-b2cd30b571dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:09.068083 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ffa3df-f813-45df-a9fc-b2cd30b571dc None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:09.068372 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ffa3df-f813-45df-a9fc-b2cd30b571dc None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:09.068644 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ffa3df-f813-45df-a9fc-b2cd30b571dc None admin] PATH_INFO: `/v3/domains` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:09.069368 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ffa3df-f813-45df-a9fc-b2cd30b571dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:53:09.069675 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ffa3df-f813-45df-a9fc-b2cd30b571dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:09.071076 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ffa3df-f813-45df-a9fc-b2cd30b571dc None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:09.082257 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 384/758] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 25 11:53:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:53:10.095309 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cdec5d-d863-4344-a652-7bb044cc2f24 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:10.095862 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cdec5d-d863-4344-a652-7bb044cc2f24 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:10.095953 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cdec5d-d863-4344-a652-7bb044cc2f24 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:10.097247 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 375/759] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:53:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:53:10.102377 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8333d-a950-42e2-960f-e76f2148313b None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:10.102802 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8333d-a950-42e2-960f-e76f2148313b None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:10.102941 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8333d-a950-42e2-960f-e76f2148313b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:10.119417 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-dba8333d-a950-42e2-960f-e76f2148313b None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:53:10.120620 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-dba8333d-a950-42e2-960f-e76f2148313b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:53:10.122563 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:10.190165 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 385/760] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:53:10 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 11:53:10.214139 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cdec5d-d863-4344-a652-7bb044cc2f24 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:10.320046 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cdec5d-d863-4344-a652-7bb044cc2f24 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:10.353564 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4cb11-0b91-467d-9374-2a83f1885648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:10.354158 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4cb11-0b91-467d-9374-2a83f1885648 None admin] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:10.354448 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4cb11-0b91-467d-9374-2a83f1885648 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:10.354728 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4cb11-0b91-467d-9374-2a83f1885648 None admin] PATH_INFO: `/v3/services` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:10.355446 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa4cb11-0b91-467d-9374-2a83f1885648 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:10.356851 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa4cb11-0b91-467d-9374-2a83f1885648 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:10.371035 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 376/761] 10.222.0.44 () {60 vars in 1141 bytes} [Wed May 25 11:53:10 2022] POST /identity/v3/services => generated 251 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 11:53:10.656515 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5677e4-d854-4338-b654-0063ed7dbd67 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:10.656809 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5677e4-d854-4338-b654-0063ed7dbd67 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:10.657086 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5677e4-d854-4338-b654-0063ed7dbd67 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:10.658479 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 386/762] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:53:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:53:10.663842 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ccaf8-414c-4ec5-87d7-a3f99995510f None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:10.664144 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ccaf8-414c-4ec5-87d7-a3f99995510f None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:10.664432 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ccaf8-414c-4ec5-87d7-a3f99995510f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:10.681322 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-789ccaf8-414c-4ec5-87d7-a3f99995510f None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:53:10.682502 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-789ccaf8-414c-4ec5-87d7-a3f99995510f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:53:10.710625 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:10.754768 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 377/763] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:53:10 2022] POST /identity/v3/auth/tokens => generated 1497 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 11:53:10.778856 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5677e4-d854-4338-b654-0063ed7dbd67 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:10.882315 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5677e4-d854-4338-b654-0063ed7dbd67 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:10.916802 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c88467c-f741-43bf-848f-9c4ea5f6ab58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:10.917380 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88467c-f741-43bf-848f-9c4ea5f6ab58 None admin] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:10.917703 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88467c-f741-43bf-848f-9c4ea5f6ab58 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:10.917947 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88467c-f741-43bf-848f-9c4ea5f6ab58 None admin] PATH_INFO: `/v3/services` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:10.918694 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c88467c-f741-43bf-848f-9c4ea5f6ab58 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:10.920127 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c88467c-f741-43bf-848f-9c4ea5f6ab58 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:10.929050 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:10.947828 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 387/764] 10.222.0.44 () {60 vars in 1141 bytes} [Wed May 25 11:53:10 2022] POST /identity/v3/services => generated 269 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 11:53:12.640769 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db3db1-e393-4fd3-b51d-c8ff4949efd5 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:12.641274 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db3db1-e393-4fd3-b51d-c8ff4949efd5 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:12.641274 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db3db1-e393-4fd3-b51d-c8ff4949efd5 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:12.642608 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 378/765] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:53:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:53:12.651725 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b91b93-8dd5-41fe-92ca-b7334292ae33 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:12.651725 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b91b93-8dd5-41fe-92ca-b7334292ae33 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:12.651725 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b91b93-8dd5-41fe-92ca-b7334292ae33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:12.666876 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-b9b91b93-8dd5-41fe-92ca-b7334292ae33 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:53:12.668114 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-b9b91b93-8dd5-41fe-92ca-b7334292ae33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:53:12.740900 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 388/766] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:53:12 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 11:53:12.764028 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db3db1-e393-4fd3-b51d-c8ff4949efd5 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:12.863527 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db3db1-e393-4fd3-b51d-c8ff4949efd5 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:12.896379 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38b6dac-ce8d-4bb6-9faa-edc9c70ab2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:12.897107 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b6dac-ce8d-4bb6-9faa-edc9c70ab2b8 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:12.897391 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b6dac-ce8d-4bb6-9faa-edc9c70ab2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:12.897667 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b6dac-ce8d-4bb6-9faa-edc9c70ab2b8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:12.898329 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38b6dac-ce8d-4bb6-9faa-edc9c70ab2b8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:12.900259 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38b6dac-ce8d-4bb6-9faa-edc9c70ab2b8 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:12.911767 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-c38b6dac-ce8d-4bb6-9faa-edc9c70ab2b8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 11:53:12.911767 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:53:12.911767 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 11:53:12.911767 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 11:53:12.911767 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 11:53:12.911767 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 11:53:12.911767 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 11:53:12.911767 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 11:53:12.911767 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 11:53:12.911767 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:53:12.911767 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 11:53:12.911767 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:53:12.911767 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:53:12.911767 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:53:12.911767 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:53:12.911767 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:53:12.911767 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:53:12.912779 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:53:12.912779 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:53:12.912779 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:53:12.912779 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:53:12.912779 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:53:12.912779 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:53:12.912779 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 11:53:12.912779 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 11:53:12.912779 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 11:53:12.912779 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 11:53:12.912779 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:53:12.912779 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:53:12.912779 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:53:12.912779 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:53:12.912779 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:53:12.912779 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:53:12.913763 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:53:12.913763 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:53:12.913763 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:53:12.913763 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:53:12.913763 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:53:12.913763 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:53:12.913763 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:53:12.913763 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:53:12.913763 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:53:12.913763 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:53:12.913763 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 11:53:12.913763 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 11:53:12.913763 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 11:53:12.913763 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:53:12.913763 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 379/767] 10.222.0.44 () {56 vars in 1114 bytes} [Wed May 25 11:53:12 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:53:12.920737 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b91b93-8dd5-41fe-92ca-b7334292ae33 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:13.019991 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b91b93-8dd5-41fe-92ca-b7334292ae33 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:13.045657 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:13.056327 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81ece9-fa27-4ae7-8985-149a248b3f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:13.056991 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81ece9-fa27-4ae7-8985-149a248b3f35 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:13.057274 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81ece9-fa27-4ae7-8985-149a248b3f35 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:13.057551 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81ece9-fa27-4ae7-8985-149a248b3f35 None admin] PATH_INFO: `/v3/services` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:13.058258 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df81ece9-fa27-4ae7-8985-149a248b3f35 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:53:13.058565 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df81ece9-fa27-4ae7-8985-149a248b3f35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:13.059979 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df81ece9-fa27-4ae7-8985-149a248b3f35 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:13.064577 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 389/768] 10.222.0.44 () {56 vars in 1114 bytes} [Wed May 25 11:53:12 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:53:13.070180 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38b6dac-ce8d-4bb6-9faa-edc9c70ab2b8 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:13.098434 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:13.171432 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38b6dac-ce8d-4bb6-9faa-edc9c70ab2b8 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:13.200220 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26150600-45b4-4c19-af80-65c9b935e0cb None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:13.200592 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26150600-45b4-4c19-af80-65c9b935e0cb None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:13.200945 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26150600-45b4-4c19-af80-65c9b935e0cb None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:13.202380 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 390/769] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:53:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 11:53:13.206757 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e09ba4-7895-4f42-89d5-f7dad6a5bf81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:13.207267 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f21170-4eed-43d6-834f-9bdd2c7a9351 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:13.207420 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e09ba4-7895-4f42-89d5-f7dad6a5bf81 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:13.207548 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f21170-4eed-43d6-834f-9bdd2c7a9351 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:13.207704 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e09ba4-7895-4f42-89d5-f7dad6a5bf81 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:13.207853 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f21170-4eed-43d6-834f-9bdd2c7a9351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:13.208012 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e09ba4-7895-4f42-89d5-f7dad6a5bf81 None admin] PATH_INFO: `/v3/services` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:13.208713 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e09ba4-7895-4f42-89d5-f7dad6a5bf81 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:53:13.209019 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e09ba4-7895-4f42-89d5-f7dad6a5bf81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:13.210396 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e09ba4-7895-4f42-89d5-f7dad6a5bf81 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:13.215866 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 380/770] 10.222.0.44 () {56 vars in 1114 bytes} [Wed May 25 11:53:13 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:53:13.221244 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e09ba4-7895-4f42-89d5-f7dad6a5bf81 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:13.224711 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-f2f21170-4eed-43d6-834f-9bdd2c7a9351 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:53:13.225894 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-f2f21170-4eed-43d6-834f-9bdd2c7a9351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:53:13.291365 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 391/771] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:53:13 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 11:53:13.310753 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:13.316019 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f21170-4eed-43d6-834f-9bdd2c7a9351 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:13.320798 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e09ba4-7895-4f42-89d5-f7dad6a5bf81 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:13.355265 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa56967d-040c-489c-a8eb-1e86b7c9dcb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:13.355954 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa56967d-040c-489c-a8eb-1e86b7c9dcb0 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:13.356240 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa56967d-040c-489c-a8eb-1e86b7c9dcb0 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:13.356515 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa56967d-040c-489c-a8eb-1e86b7c9dcb0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:13.357297 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa56967d-040c-489c-a8eb-1e86b7c9dcb0 None admin] RBAC: Adding query filter params (interface=public, service_id=058d3427e0f0477585fc8dce3fabf589, region_id=RegionOne) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:53:13.357606 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa56967d-040c-489c-a8eb-1e86b7c9dcb0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:13.358986 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa56967d-040c-489c-a8eb-1e86b7c9dcb0 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:13.366408 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 381/772] 10.222.0.44 () {56 vars in 1251 bytes} [Wed May 25 11:53:13 2022] GET /identity/v3/endpoints?service_id=058d3427e0f0477585fc8dce3fabf589&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:53:13.372427 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa56967d-040c-489c-a8eb-1e86b7c9dcb0 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:13.411493 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f21170-4eed-43d6-834f-9bdd2c7a9351 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:13.428455 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:13.446109 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d742cf8-f7cb-42d8-9199-48f24d357315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:13.446916 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d742cf8-f7cb-42d8-9199-48f24d357315 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:13.447198 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d742cf8-f7cb-42d8-9199-48f24d357315 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:13.447474 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d742cf8-f7cb-42d8-9199-48f24d357315 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:13.448169 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d742cf8-f7cb-42d8-9199-48f24d357315 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:13.449532 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d742cf8-f7cb-42d8-9199-48f24d357315 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:13.461979 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-5d742cf8-f7cb-42d8-9199-48f24d357315 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 11:53:13.461979 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:53:13.461979 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 11:53:13.461979 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 11:53:13.461979 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 11:53:13.461979 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 11:53:13.461979 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 11:53:13.461979 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 11:53:13.461979 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 11:53:13.461979 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:53:13.461979 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 11:53:13.461979 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:53:13.461979 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:53:13.461979 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:53:13.461979 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:53:13.461979 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:53:13.462927 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:53:13.462927 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:53:13.462927 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:53:13.462927 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:53:13.462927 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:53:13.462927 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:53:13.462927 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:53:13.462927 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 11:53:13.462927 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 11:53:13.462927 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 11:53:13.462927 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 11:53:13.462927 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:53:13.462927 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:53:13.462927 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:53:13.462927 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:53:13.462927 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:53:13.463779 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:53:13.463779 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:53:13.463779 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:53:13.463779 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:53:13.463779 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:53:13.463779 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:53:13.463779 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:53:13.463779 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:53:13.463779 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:53:13.463779 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:53:13.463779 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:53:13.463779 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 11:53:13.463779 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 11:53:13.463779 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 11:53:13.463779 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:53:13.463779 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 392/773] 10.222.0.44 () {56 vars in 1132 bytes} [Wed May 25 11:53:13 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 11:53:13.470317 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d742cf8-f7cb-42d8-9199-48f24d357315 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:13.470559 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa56967d-040c-489c-a8eb-1e86b7c9dcb0 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:13.504355 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d63b34-2710-4c66-afc3-9927fea066f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:13.505026 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d63b34-2710-4c66-afc3-9927fea066f5 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:13.505316 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d63b34-2710-4c66-afc3-9927fea066f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:13.505601 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d63b34-2710-4c66-afc3-9927fea066f5 None admin] PATH_INFO: `/v3/services` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:13.506282 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d63b34-2710-4c66-afc3-9927fea066f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:13.507656 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d63b34-2710-4c66-afc3-9927fea066f5 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:13.513527 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 382/774] 10.222.0.44 () {56 vars in 1087 bytes} [Wed May 25 11:53:13 2022] GET /identity/v3/services => generated 1498 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 11:53:13.574273 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d742cf8-f7cb-42d8-9199-48f24d357315 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:13.610815 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5202fe3a-1525-41b9-9f6a-5b9b4bb83abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:13.611497 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202fe3a-1525-41b9-9f6a-5b9b4bb83abd None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:13.611782 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202fe3a-1525-41b9-9f6a-5b9b4bb83abd None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:13.612087 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202fe3a-1525-41b9-9f6a-5b9b4bb83abd None admin] PATH_INFO: `/v3/services` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:13.612804 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5202fe3a-1525-41b9-9f6a-5b9b4bb83abd None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:53:13.613115 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5202fe3a-1525-41b9-9f6a-5b9b4bb83abd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:13.614497 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5202fe3a-1525-41b9-9f6a-5b9b4bb83abd None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:13.619878 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 393/775] 10.222.0.44 () {56 vars in 1126 bytes} [Wed May 25 11:53:13 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:53:13.625717 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d63b34-2710-4c66-afc3-9927fea066f5 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:13.646080 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:13.729800 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d63b34-2710-4c66-afc3-9927fea066f5 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:13.761657 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1c23d-ac64-447d-9f3b-5404edd7d52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:13.762321 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1c23d-ac64-447d-9f3b-5404edd7d52b None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:13.762607 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1c23d-ac64-447d-9f3b-5404edd7d52b None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:13.762884 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1c23d-ac64-447d-9f3b-5404edd7d52b None admin] PATH_INFO: `/v3/services` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:13.763584 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a1c23d-ac64-447d-9f3b-5404edd7d52b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:53:13.763928 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a1c23d-ac64-447d-9f3b-5404edd7d52b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:13.765288 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a1c23d-ac64-447d-9f3b-5404edd7d52b None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:13.770926 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 383/776] 10.222.0.44 () {56 vars in 1126 bytes} [Wed May 25 11:53:13 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:53:13.777229 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5202fe3a-1525-41b9-9f6a-5b9b4bb83abd None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:13.823453 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:13.879657 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5202fe3a-1525-41b9-9f6a-5b9b4bb83abd None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:13.917088 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf72213-6287-4c82-8199-1a50d29a3e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:13.917738 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf72213-6287-4c82-8199-1a50d29a3e64 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:13.918021 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf72213-6287-4c82-8199-1a50d29a3e64 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:13.918296 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf72213-6287-4c82-8199-1a50d29a3e64 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:13.919080 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf72213-6287-4c82-8199-1a50d29a3e64 None admin] RBAC: Adding query filter params (interface=public, service_id=d852f94721f54220bef825263421fbcb, region_id=RegionOne) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:53:13.919394 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf72213-6287-4c82-8199-1a50d29a3e64 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:13.920791 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf72213-6287-4c82-8199-1a50d29a3e64 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:13.925646 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 394/777] 10.222.0.44 () {56 vars in 1251 bytes} [Wed May 25 11:53:13 2022] GET /identity/v3/endpoints?service_id=d852f94721f54220bef825263421fbcb&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:53:13.931545 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1c23d-ac64-447d-9f3b-5404edd7d52b None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:14.011170 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:14.029829 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1c23d-ac64-447d-9f3b-5404edd7d52b None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:14.061979 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31996fac-2920-489e-9983-80b3ebdb76f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:14.062666 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31996fac-2920-489e-9983-80b3ebdb76f0 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:14.062951 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31996fac-2920-489e-9983-80b3ebdb76f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:14.063228 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31996fac-2920-489e-9983-80b3ebdb76f0 None admin] PATH_INFO: `/v3/services` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:14.063938 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31996fac-2920-489e-9983-80b3ebdb76f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:14.065297 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31996fac-2920-489e-9983-80b3ebdb76f0 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:14.071652 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 384/778] 10.222.0.44 () {56 vars in 1087 bytes} [Wed May 25 11:53:13 2022] GET /identity/v3/services => generated 1498 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 11:53:15.785104 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb8409-663a-45d3-94bb-eb2f30ee9905 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:15.785654 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb8409-663a-45d3-94bb-eb2f30ee9905 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:15.785748 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb8409-663a-45d3-94bb-eb2f30ee9905 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:15.787075 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 395/779] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:53:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:53:15.792301 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec3e10-6804-4b88-85c3-31e40c8feefd None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:15.792737 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec3e10-6804-4b88-85c3-31e40c8feefd None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:15.792992 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec3e10-6804-4b88-85c3-31e40c8feefd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:15.810155 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-60ec3e10-6804-4b88-85c3-31e40c8feefd None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:53:15.811347 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-60ec3e10-6804-4b88-85c3-31e40c8feefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:53:15.876660 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 385/780] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:53:15 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 11:53:15.903846 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb8409-663a-45d3-94bb-eb2f30ee9905 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:16.006787 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb8409-663a-45d3-94bb-eb2f30ee9905 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:16.018057 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:16.041231 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a5d0a7-6718-4d32-9fd4-82cf6ebe6861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:16.041954 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a5d0a7-6718-4d32-9fd4-82cf6ebe6861 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:16.042231 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a5d0a7-6718-4d32-9fd4-82cf6ebe6861 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:16.042499 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a5d0a7-6718-4d32-9fd4-82cf6ebe6861 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:16.043135 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a5d0a7-6718-4d32-9fd4-82cf6ebe6861 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:16.044523 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a5d0a7-6718-4d32-9fd4-82cf6ebe6861 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:16.056641 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-26a5d0a7-6718-4d32-9fd4-82cf6ebe6861 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 11:53:16.056641 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:53:16.056641 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 11:53:16.056641 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 11:53:16.056641 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 11:53:16.056641 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 11:53:16.056641 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 11:53:16.056641 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 11:53:16.056641 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 11:53:16.056641 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:53:16.056641 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 11:53:16.056641 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:53:16.056641 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:53:16.056641 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:53:16.056641 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:53:16.056641 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:53:16.056641 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:53:16.057776 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:53:16.057776 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:53:16.057776 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:53:16.057776 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:53:16.057776 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:53:16.057776 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:53:16.057776 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 11:53:16.057776 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 11:53:16.057776 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 11:53:16.057776 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 11:53:16.057776 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:53:16.057776 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:53:16.057776 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:53:16.057776 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:53:16.057776 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:53:16.057776 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:53:16.058709 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:53:16.058709 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:53:16.058709 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:53:16.058709 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:53:16.058709 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:53:16.058709 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:53:16.058709 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:53:16.058709 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:53:16.058709 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:53:16.058709 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:53:16.058709 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 11:53:16.058709 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 11:53:16.058709 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 11:53:16.058709 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:53:16.058709 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 396/781] 10.222.0.44 () {56 vars in 1114 bytes} [Wed May 25 11:53:15 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 11:53:16.064999 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ec3e10-6804-4b88-85c3-31e40c8feefd None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:16.142586 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:16.167295 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ec3e10-6804-4b88-85c3-31e40c8feefd None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:16.201795 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99497ef2-e119-410d-b326-d91a498bb3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:16.202459 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99497ef2-e119-410d-b326-d91a498bb3f8 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:16.202744 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99497ef2-e119-410d-b326-d91a498bb3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:16.203044 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99497ef2-e119-410d-b326-d91a498bb3f8 None admin] PATH_INFO: `/v3/services` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:16.203735 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99497ef2-e119-410d-b326-d91a498bb3f8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:53:16.204088 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99497ef2-e119-410d-b326-d91a498bb3f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:16.205462 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99497ef2-e119-410d-b326-d91a498bb3f8 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:16.210050 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 386/782] 10.222.0.44 () {56 vars in 1114 bytes} [Wed May 25 11:53:16 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:53:16.215690 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a5d0a7-6718-4d32-9fd4-82cf6ebe6861 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:16.314045 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a5d0a7-6718-4d32-9fd4-82cf6ebe6861 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:16.328256 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37aa22-1f5d-4e6a-a88b-faf4c193d9db None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:16.328546 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37aa22-1f5d-4e6a-a88b-faf4c193d9db None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:16.328827 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37aa22-1f5d-4e6a-a88b-faf4c193d9db None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:16.330169 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 387/783] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:53:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 11:53:16.335265 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86ba00-6c02-4cee-b018-9084bbd16678 None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:16.335735 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86ba00-6c02-4cee-b018-9084bbd16678 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:16.336083 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86ba00-6c02-4cee-b018-9084bbd16678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:16.347250 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252980e8-1a0f-442f-9f1e-de8c1ab7a154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:16.347967 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252980e8-1a0f-442f-9f1e-de8c1ab7a154 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:16.348253 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252980e8-1a0f-442f-9f1e-de8c1ab7a154 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:16.348530 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252980e8-1a0f-442f-9f1e-de8c1ab7a154 None admin] PATH_INFO: `/v3/services` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:16.349232 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252980e8-1a0f-442f-9f1e-de8c1ab7a154 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:53:16.349542 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252980e8-1a0f-442f-9f1e-de8c1ab7a154 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:16.350903 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252980e8-1a0f-442f-9f1e-de8c1ab7a154 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:16.352956 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-5c86ba00-6c02-4cee-b018-9084bbd16678 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:53:16.354148 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-5c86ba00-6c02-4cee-b018-9084bbd16678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:53:16.356200 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 397/784] 10.222.0.44 () {56 vars in 1114 bytes} [Wed May 25 11:53:16 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:53:16.361609 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252980e8-1a0f-442f-9f1e-de8c1ab7a154 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:16.400060 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:16.422201 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 388/785] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:53:16 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 11:53:16.446648 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86ba00-6c02-4cee-b018-9084bbd16678 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:16.460283 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252980e8-1a0f-442f-9f1e-de8c1ab7a154 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:16.501175 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1497d3b2-3575-4eb8-b587-df5ff7f9b7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:16.501826 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497d3b2-3575-4eb8-b587-df5ff7f9b7b0 None admin] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:16.502110 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497d3b2-3575-4eb8-b587-df5ff7f9b7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:16.502386 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497d3b2-3575-4eb8-b587-df5ff7f9b7b0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:16.503121 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1497d3b2-3575-4eb8-b587-df5ff7f9b7b0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:16.504572 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1497d3b2-3575-4eb8-b587-df5ff7f9b7b0 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:16.512958 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:16.523119 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 398/786] 10.222.0.44 () {60 vars in 1144 bytes} [Wed May 25 11:53:16 2022] POST /identity/v3/endpoints => generated 346 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 11:53:16.545677 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86ba00-6c02-4cee-b018-9084bbd16678 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:16.587886 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630f0b8-7f34-49a2-a58d-028c4a6de94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:16.588640 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630f0b8-7f34-49a2-a58d-028c4a6de94d None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:16.588927 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630f0b8-7f34-49a2-a58d-028c4a6de94d None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:16.589206 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630f0b8-7f34-49a2-a58d-028c4a6de94d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:16.589869 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3630f0b8-7f34-49a2-a58d-028c4a6de94d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:16.591279 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3630f0b8-7f34-49a2-a58d-028c4a6de94d None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:16.604900 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-3630f0b8-7f34-49a2-a58d-028c4a6de94d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 11:53:16.604900 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:53:16.604900 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 11:53:16.604900 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 11:53:16.604900 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 11:53:16.604900 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 11:53:16.604900 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 11:53:16.604900 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 11:53:16.604900 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 11:53:16.604900 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:53:16.604900 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 11:53:16.604900 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:53:16.604900 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:53:16.604900 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:53:16.604900 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:53:16.604900 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:53:16.606097 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:53:16.606097 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:53:16.606097 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:53:16.606097 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:53:16.606097 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:53:16.606097 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:53:16.606097 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:53:16.606097 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 11:53:16.606097 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 11:53:16.606097 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 11:53:16.606097 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 11:53:16.606097 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:53:16.606097 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:53:16.606097 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:53:16.606097 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:53:16.606097 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:53:16.606972 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:53:16.606972 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:53:16.606972 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:53:16.606972 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:53:16.606972 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:53:16.606972 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:53:16.606972 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:53:16.606972 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:53:16.606972 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:53:16.606972 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:53:16.606972 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:53:16.606972 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 11:53:16.606972 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 11:53:16.606972 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 11:53:16.606972 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:53:16.606972 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 389/787] 10.222.0.44 () {56 vars in 1132 bytes} [Wed May 25 11:53:16 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 11:53:16.614186 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1497d3b2-3575-4eb8-b587-df5ff7f9b7b0 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:16.709471 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:16.719243 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1497d3b2-3575-4eb8-b587-df5ff7f9b7b0 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:16.753079 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8273efb-b293-4bc9-a2f3-f2aef4108094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:16.753743 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8273efb-b293-4bc9-a2f3-f2aef4108094 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:16.754026 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8273efb-b293-4bc9-a2f3-f2aef4108094 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:16.754301 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8273efb-b293-4bc9-a2f3-f2aef4108094 None admin] PATH_INFO: `/v3/services` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:16.755007 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8273efb-b293-4bc9-a2f3-f2aef4108094 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:53:16.755315 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8273efb-b293-4bc9-a2f3-f2aef4108094 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:16.756779 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8273efb-b293-4bc9-a2f3-f2aef4108094 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:16.761444 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 399/788] 10.222.0.44 () {56 vars in 1126 bytes} [Wed May 25 11:53:16 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:53:16.767080 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630f0b8-7f34-49a2-a58d-028c4a6de94d None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:16.864989 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630f0b8-7f34-49a2-a58d-028c4a6de94d None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:16.892839 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:16.899968 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5503336e-a8c0-4b48-8077-c177ed78d08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:16.900624 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5503336e-a8c0-4b48-8077-c177ed78d08e None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:16.900907 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5503336e-a8c0-4b48-8077-c177ed78d08e None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:16.901185 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5503336e-a8c0-4b48-8077-c177ed78d08e None admin] PATH_INFO: `/v3/services` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:16.901879 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5503336e-a8c0-4b48-8077-c177ed78d08e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:53:16.902186 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5503336e-a8c0-4b48-8077-c177ed78d08e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:16.903546 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5503336e-a8c0-4b48-8077-c177ed78d08e None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:16.908351 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 390/789] 10.222.0.44 () {56 vars in 1126 bytes} [Wed May 25 11:53:16 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:53:16.913935 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8273efb-b293-4bc9-a2f3-f2aef4108094 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:17.009755 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8273efb-b293-4bc9-a2f3-f2aef4108094 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:17.043251 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a5d026-cca8-4aaa-8b05-e965509d2e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:17.043933 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5d026-cca8-4aaa-8b05-e965509d2e49 None admin] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:17.044219 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5d026-cca8-4aaa-8b05-e965509d2e49 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:17.044493 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5d026-cca8-4aaa-8b05-e965509d2e49 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:17.045229 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a5d026-cca8-4aaa-8b05-e965509d2e49 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:17.046591 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a5d026-cca8-4aaa-8b05-e965509d2e49 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:17.065446 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 400/790] 10.222.0.44 () {60 vars in 1144 bytes} [Wed May 25 11:53:16 2022] POST /identity/v3/endpoints => generated 347 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 11:53:18.813941 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62dcdb-398f-468e-b207-25007458d37d None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:18.814517 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62dcdb-398f-468e-b207-25007458d37d None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:18.814517 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62dcdb-398f-468e-b207-25007458d37d None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:18.816151 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 391/791] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:53:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:53:18.821472 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94c640-3fac-41cc-a0a8-8c29ffd4014b None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:18.821939 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94c640-3fac-41cc-a0a8-8c29ffd4014b None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:18.822096 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94c640-3fac-41cc-a0a8-8c29ffd4014b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:18.840707 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-9a94c640-3fac-41cc-a0a8-8c29ffd4014b None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:53:18.841906 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-9a94c640-3fac-41cc-a0a8-8c29ffd4014b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:53:18.852689 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:18.919923 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 401/792] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:53:18 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 11:53:18.945457 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d62dcdb-398f-468e-b207-25007458d37d None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:19.052263 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d62dcdb-398f-468e-b207-25007458d37d None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:19.088275 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefe8afc-2ab4-443b-bb8b-4ad5afea7706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:19.088850 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe8afc-2ab4-443b-bb8b-4ad5afea7706 None admin] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:19.089129 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe8afc-2ab4-443b-bb8b-4ad5afea7706 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:19.089402 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe8afc-2ab4-443b-bb8b-4ad5afea7706 None admin] PATH_INFO: `/v3/projects` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:19.090108 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefe8afc-2ab4-443b-bb8b-4ad5afea7706 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:19.091528 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefe8afc-2ab4-443b-bb8b-4ad5afea7706 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:19.092897 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: WARNING keystone.server.flask.common [None req-cefe8afc-2ab4-443b-bb8b-4ad5afea7706 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 25 11:53:19.111655 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.sql.core [None req-cefe8afc-2ab4-443b-bb8b-4ad5afea7706 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 25 11:53:19.111655 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 25 11:53:19.111655 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [parameters: {'id': '456a12de1206418ea4279fd5b2750bec', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 25 11:53:19.111655 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86938) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 25 11:53:19.129240 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-cefe8afc-2ab4-443b-bb8b-4ad5afea7706 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 456a12de1206418ea4279fd5b2750bec.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 456a12de1206418ea4279fd5b2750bec. May 25 11:53:19.129240 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:53:19.129240 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 11:53:19.129240 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 11:53:19.129240 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 11:53:19.129240 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 11:53:19.129240 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 11:53:19.129240 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application result = self._query(query) May 25 11:53:19.129240 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 11:53:19.129240 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application conn.query(q) May 25 11:53:19.129240 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 11:53:19.129240 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 11:53:19.129240 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 11:53:19.130472 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application result.read() May 25 11:53:19.130472 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 11:53:19.130472 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 11:53:19.130472 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 11:53:19.130472 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 11:53:19.130472 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 11:53:19.130472 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 11:53:19.130472 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 11:53:19.130472 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 11:53:19.130472 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 25 11:53:19.130472 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:53:19.130472 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 25 11:53:19.130472 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:53:19.130472 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:53:19.130472 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 25 11:53:19.130472 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 25 11:53:19.130472 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 25 11:53:19.130472 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return project_ref.to_dict() May 25 11:53:19.131545 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 11:53:19.131545 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application next(self.gen) May 25 11:53:19.131545 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 25 11:53:19.131545 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application yield resource May 25 11:53:19.131545 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 11:53:19.131545 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application next(self.gen) May 25 11:53:19.131545 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 25 11:53:19.131545 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application self.session.rollback() May 25 11:53:19.131545 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 25 11:53:19.131545 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application self.force_reraise() May 25 11:53:19.131545 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 25 11:53:19.131545 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise self.value May 25 11:53:19.131545 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 25 11:53:19.131545 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 25 11:53:19.131545 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 25 11:53:19.131545 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application session.commit() May 25 11:53:19.131545 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 25 11:53:19.132608 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 25 11:53:19.132608 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 25 11:53:19.132608 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application self._prepare_impl() May 25 11:53:19.132608 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 25 11:53:19.132608 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application self.session.flush() May 25 11:53:19.132608 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 25 11:53:19.132608 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application self._flush(objects) May 25 11:53:19.132608 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 25 11:53:19.132608 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 25 11:53:19.132608 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 25 11:53:19.132608 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application compat.raise_( May 25 11:53:19.132608 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 11:53:19.132608 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception May 25 11:53:19.132608 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 25 11:53:19.132608 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application flush_context.execute() May 25 11:53:19.132608 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 25 11:53:19.132608 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rec.execute(self) May 25 11:53:19.134081 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 25 11:53:19.134081 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 25 11:53:19.134081 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 25 11:53:19.134081 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application _emit_insert_statements( May 25 11:53:19.134081 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 25 11:53:19.134081 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application c = connection._execute_20( May 25 11:53:19.134081 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 25 11:53:19.134081 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 25 11:53:19.134081 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 25 11:53:19.134081 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 25 11:53:19.134081 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 25 11:53:19.134081 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application ret = self._execute_context( May 25 11:53:19.134081 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 25 11:53:19.134081 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 25 11:53:19.134081 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 25 11:53:19.134910 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 25 11:53:19.134910 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 11:53:19.134910 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception May 25 11:53:19.134910 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 11:53:19.134910 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 11:53:19.134910 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 11:53:19.134910 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 11:53:19.134910 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 11:53:19.134910 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application result = self._query(query) May 25 11:53:19.134910 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 11:53:19.134910 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application conn.query(q) May 25 11:53:19.134910 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 11:53:19.134910 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 11:53:19.134910 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 11:53:19.134910 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application result.read() May 25 11:53:19.134910 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 11:53:19.134910 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 11:53:19.136463 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 11:53:19.136463 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 11:53:19.136463 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 11:53:19.136463 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 11:53:19.136463 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 11:53:19.136463 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 11:53:19.136463 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 25 11:53:19.136463 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 25 11:53:19.136463 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [parameters: {'id': '456a12de1206418ea4279fd5b2750bec', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 25 11:53:19.136463 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 25 11:53:19.136463 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:53:19.136463 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 11:53:19.136463 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:53:19.136463 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:53:19.136463 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 25 11:53:19.138958 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 25 11:53:19.138958 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 25 11:53:19.138958 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 25 11:53:19.138958 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 25 11:53:19.138958 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:53:19.138958 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 11:53:19.138958 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:53:19.138958 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:53:19.138958 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:53:19.138958 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:53:19.138958 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:53:19.138958 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:53:19.138958 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:53:19.138958 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:53:19.138958 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:53:19.138958 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:53:19.138958 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:53:19.141015 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:53:19.141015 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 25 11:53:19.141015 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 25 11:53:19.141015 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:53:19.141015 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:53:19.141015 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 25 11:53:19.141015 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.Conflict( May 25 11:53:19.141015 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 456a12de1206418ea4279fd5b2750bec. May 25 11:53:19.141015 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:53:19.141015 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 392/793] 10.222.0.44 () {60 vars in 1140 bytes} [Wed May 25 11:53:18 2022] POST /identity/v3/projects => generated 262 bytes in 186 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 25 11:53:19.141714 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a94c640-3fac-41cc-a0a8-8c29ffd4014b None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:19.247551 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a94c640-3fac-41cc-a0a8-8c29ffd4014b None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:19.280679 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec6bf6e-d413-4f9b-babd-025527750e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:19.281478 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec6bf6e-d413-4f9b-babd-025527750e3f None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:19.281761 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec6bf6e-d413-4f9b-babd-025527750e3f None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:19.282038 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec6bf6e-d413-4f9b-babd-025527750e3f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:19.288724 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec6bf6e-d413-4f9b-babd-025527750e3f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:19.290682 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec6bf6e-d413-4f9b-babd-025527750e3f None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:19.293239 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:19.305676 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-6ec6bf6e-d413-4f9b-babd-025527750e3f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 11:53:19.305676 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:53:19.305676 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:53:19.305676 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:53:19.305676 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:53:19.305676 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:53:19.305676 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:53:19.305676 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:53:19.305676 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:53:19.305676 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:53:19.305676 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:53:19.305676 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:53:19.305676 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 11:53:19.305676 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 11:53:19.305676 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 11:53:19.306607 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 11:53:19.306607 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:53:19.306607 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:53:19.306607 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:53:19.306607 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:53:19.306607 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:53:19.306607 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:53:19.306607 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:53:19.306607 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:53:19.306607 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:53:19.306607 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:53:19.306607 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:53:19.306607 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:53:19.306607 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:53:19.306607 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:53:19.306607 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:53:19.306607 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:53:19.307504 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 11:53:19.307504 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 11:53:19.307504 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 11:53:19.307504 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 11:53:19.307504 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 11:53:19.307504 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 11:53:19.307504 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 11:53:19.307504 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:53:19.309424 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 402/794] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 25 11:53:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:53:19.315486 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefe8afc-2ab4-443b-bb8b-4ad5afea7706 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:19.350219 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e8437-9bfb-44d8-a338-be9de48cb06b None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:19.350435 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e8437-9bfb-44d8-a338-be9de48cb06b None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:19.350708 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e8437-9bfb-44d8-a338-be9de48cb06b None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:19.352608 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 403/795] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:53:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 11:53:19.357577 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20076ff7-c589-4902-a87f-9b3e7650cb40 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:19.357862 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20076ff7-c589-4902-a87f-9b3e7650cb40 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:19.358137 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20076ff7-c589-4902-a87f-9b3e7650cb40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:19.368908 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:19.375282 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-20076ff7-c589-4902-a87f-9b3e7650cb40 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:53:19.376496 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-20076ff7-c589-4902-a87f-9b3e7650cb40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:53:19.418508 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefe8afc-2ab4-443b-bb8b-4ad5afea7706 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:19.443478 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 404/796] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:53:19 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 11:53:19.451844 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4fb9b7-569a-4ccc-9325-f5d6be5aad1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:19.452510 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4fb9b7-569a-4ccc-9325-f5d6be5aad1a None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:19.452797 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4fb9b7-569a-4ccc-9325-f5d6be5aad1a None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:19.453074 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4fb9b7-569a-4ccc-9325-f5d6be5aad1a None admin] PATH_INFO: `/v3/projects` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:19.453821 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4fb9b7-569a-4ccc-9325-f5d6be5aad1a None admin] RBAC: Adding query filter params (name=service) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:53:19.454130 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4fb9b7-569a-4ccc-9325-f5d6be5aad1a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:19.455748 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4fb9b7-569a-4ccc-9325-f5d6be5aad1a None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:19.466347 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20076ff7-c589-4902-a87f-9b3e7650cb40 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:19.475768 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 393/797] 10.222.0.44 () {56 vars in 1112 bytes} [Wed May 25 11:53:19 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:53:19.568950 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20076ff7-c589-4902-a87f-9b3e7650cb40 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:19.598628 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:19.605756 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9df616-b86e-41e0-9a37-b4139b390813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:19.606491 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9df616-b86e-41e0-9a37-b4139b390813 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:19.606780 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9df616-b86e-41e0-9a37-b4139b390813 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:19.607061 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9df616-b86e-41e0-9a37-b4139b390813 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:19.607952 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9df616-b86e-41e0-9a37-b4139b390813 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:19.609369 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9df616-b86e-41e0-9a37-b4139b390813 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:19.621997 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-ec9df616-b86e-41e0-9a37-b4139b390813 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 25 11:53:19.621997 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:53:19.621997 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 11:53:19.621997 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 11:53:19.621997 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 11:53:19.621997 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 11:53:19.621997 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 11:53:19.621997 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 11:53:19.621997 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 11:53:19.621997 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:53:19.621997 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 11:53:19.621997 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:53:19.621997 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:53:19.621997 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:53:19.621997 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:53:19.621997 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:53:19.621997 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:53:19.623154 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:53:19.623154 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:53:19.623154 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:53:19.623154 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:53:19.623154 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:53:19.623154 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:53:19.623154 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 11:53:19.623154 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 11:53:19.623154 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 11:53:19.623154 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 11:53:19.623154 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:53:19.623154 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:53:19.623154 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:53:19.623154 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:53:19.623154 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:53:19.623154 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:53:19.624035 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:53:19.624035 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:53:19.624035 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:53:19.624035 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:53:19.624035 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:53:19.624035 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:53:19.624035 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:53:19.624035 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:53:19.624035 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:53:19.624035 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:53:19.624035 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 11:53:19.624035 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 11:53:19.624035 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 11:53:19.624035 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:53:19.624035 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 405/798] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 25 11:53:19 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 11:53:19.630866 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4fb9b7-569a-4ccc-9325-f5d6be5aad1a None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:19.735979 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4fb9b7-569a-4ccc-9325-f5d6be5aad1a None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:19.746082 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:19.769179 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525f13e-cf5d-4466-bb12-ad3aa2c90fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:19.769847 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525f13e-cf5d-4466-bb12-ad3aa2c90fd2 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:19.770392 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525f13e-cf5d-4466-bb12-ad3aa2c90fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:19.770667 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525f13e-cf5d-4466-bb12-ad3aa2c90fd2 None admin] PATH_INFO: `/v3/services` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:19.771362 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5525f13e-cf5d-4466-bb12-ad3aa2c90fd2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:53:19.771664 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5525f13e-cf5d-4466-bb12-ad3aa2c90fd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:19.773056 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5525f13e-cf5d-4466-bb12-ad3aa2c90fd2 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:19.778196 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 394/799] 10.222.0.44 () {56 vars in 1112 bytes} [Wed May 25 11:53:19 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:53:19.783802 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9df616-b86e-41e0-9a37-b4139b390813 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:19.883132 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9df616-b86e-41e0-9a37-b4139b390813 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:19.916702 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36d28be-0b5c-49b8-9a56-759a1b377169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:19.917655 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d28be-0b5c-49b8-9a56-759a1b377169 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:19.917655 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d28be-0b5c-49b8-9a56-759a1b377169 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:19.917894 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d28be-0b5c-49b8-9a56-759a1b377169 None admin] PATH_INFO: `/v3/services` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:19.918732 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36d28be-0b5c-49b8-9a56-759a1b377169 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:53:19.918898 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36d28be-0b5c-49b8-9a56-759a1b377169 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:19.920294 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36d28be-0b5c-49b8-9a56-759a1b377169 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:19.924824 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 406/800] 10.222.0.44 () {56 vars in 1112 bytes} [Wed May 25 11:53:19 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:53:21.788253 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a00521-882c-4839-a78f-0c165c4e7321 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:21.788817 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a00521-882c-4839-a78f-0c165c4e7321 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:21.789434 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a00521-882c-4839-a78f-0c165c4e7321 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:21.790737 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 395/801] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:53:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:53:21.795860 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da9d967-5607-4c31-a6e2-528310cc9aec None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:21.796312 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da9d967-5607-4c31-a6e2-528310cc9aec None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:21.796414 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da9d967-5607-4c31-a6e2-528310cc9aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:21.812882 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-8da9d967-5607-4c31-a6e2-528310cc9aec None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:53:21.814170 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-8da9d967-5607-4c31-a6e2-528310cc9aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:53:21.871265 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:21.886441 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 407/802] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:53:21 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 11:53:21.914691 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a00521-882c-4839-a78f-0c165c4e7321 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:22.019315 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a00521-882c-4839-a78f-0c165c4e7321 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:22.053114 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e9e4d-7f19-4baa-b734-8af30a98ca20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:22.053726 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e9e4d-7f19-4baa-b734-8af30a98ca20 None admin] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:22.054010 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e9e4d-7f19-4baa-b734-8af30a98ca20 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:22.054286 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e9e4d-7f19-4baa-b734-8af30a98ca20 None admin] PATH_INFO: `/v3/users` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:22.054999 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658e9e4d-7f19-4baa-b734-8af30a98ca20 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:22.056454 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658e9e4d-7f19-4baa-b734-8af30a98ca20 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:22.068949 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.sql.core [None req-658e9e4d-7f19-4baa-b734-8af30a98ca20 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 25 11:53:22.068949 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 25 11:53:22.068949 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [parameters: {'user_id': 'b75ccb9590b54a2c840aa5da8bd96bc9', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 25 11:53:22.068949 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86938) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 25 11:53:22.076759 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-658e9e4d-7f19-4baa-b734-8af30a98ca20 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 25 11:53:22.076759 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:53:22.076759 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 11:53:22.076759 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 11:53:22.076759 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 11:53:22.076759 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 11:53:22.076759 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 11:53:22.076759 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application result = self._query(query) May 25 11:53:22.076759 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 11:53:22.076759 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application conn.query(q) May 25 11:53:22.076759 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 11:53:22.076759 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 11:53:22.076759 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 11:53:22.076759 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application result.read() May 25 11:53:22.076759 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 11:53:22.077779 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 11:53:22.077779 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 11:53:22.077779 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 11:53:22.077779 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 11:53:22.077779 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 11:53:22.077779 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 11:53:22.077779 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 11:53:22.077779 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 25 11:53:22.077779 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:53:22.077779 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 25 11:53:22.077779 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:53:22.077779 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:53:22.077779 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 25 11:53:22.077779 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 25 11:53:22.077779 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 25 11:53:22.077779 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 25 11:53:22.077779 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 11:53:22.077779 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application next(self.gen) May 25 11:53:22.078793 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 25 11:53:22.078793 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application yield resource May 25 11:53:22.078793 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 11:53:22.078793 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application next(self.gen) May 25 11:53:22.078793 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 25 11:53:22.078793 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application self.session.rollback() May 25 11:53:22.078793 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 25 11:53:22.078793 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application self.force_reraise() May 25 11:53:22.078793 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 25 11:53:22.078793 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise self.value May 25 11:53:22.078793 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 25 11:53:22.078793 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 25 11:53:22.078793 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 25 11:53:22.078793 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application session.commit() May 25 11:53:22.078793 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 25 11:53:22.078793 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 25 11:53:22.078793 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 25 11:53:22.079688 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application self._prepare_impl() May 25 11:53:22.079688 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 25 11:53:22.079688 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application self.session.flush() May 25 11:53:22.079688 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 25 11:53:22.079688 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application self._flush(objects) May 25 11:53:22.079688 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 25 11:53:22.079688 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 25 11:53:22.079688 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 25 11:53:22.079688 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application compat.raise_( May 25 11:53:22.079688 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 11:53:22.079688 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception May 25 11:53:22.079688 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 25 11:53:22.079688 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application flush_context.execute() May 25 11:53:22.079688 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 25 11:53:22.079688 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rec.execute(self) May 25 11:53:22.079688 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 25 11:53:22.079688 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 25 11:53:22.080632 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 25 11:53:22.080632 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application _emit_insert_statements( May 25 11:53:22.080632 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 25 11:53:22.080632 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application result = connection._execute_20( May 25 11:53:22.080632 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 25 11:53:22.080632 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 25 11:53:22.080632 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 25 11:53:22.080632 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 25 11:53:22.080632 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 25 11:53:22.080632 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application ret = self._execute_context( May 25 11:53:22.080632 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 25 11:53:22.080632 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 25 11:53:22.080632 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 25 11:53:22.080632 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 25 11:53:22.080632 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 11:53:22.080632 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception May 25 11:53:22.081479 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 11:53:22.081479 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 11:53:22.081479 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 11:53:22.081479 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 11:53:22.081479 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 11:53:22.081479 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application result = self._query(query) May 25 11:53:22.081479 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 11:53:22.081479 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application conn.query(q) May 25 11:53:22.081479 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 11:53:22.081479 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 11:53:22.081479 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 11:53:22.081479 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application result.read() May 25 11:53:22.081479 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 11:53:22.081479 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 11:53:22.081479 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 11:53:22.081479 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 11:53:22.082318 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 11:53:22.082318 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 11:53:22.082318 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 11:53:22.082318 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 11:53:22.082318 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 25 11:53:22.082318 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 25 11:53:22.082318 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [parameters: {'user_id': 'b75ccb9590b54a2c840aa5da8bd96bc9', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 25 11:53:22.082318 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 25 11:53:22.082318 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:53:22.082318 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 11:53:22.082318 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:53:22.082318 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:53:22.082318 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:53:22.082318 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:53:22.082318 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:53:22.083110 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:53:22.083110 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:53:22.083110 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:53:22.083110 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:53:22.083110 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:53:22.083110 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:53:22.083110 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:53:22.083110 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 25 11:53:22.083110 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 25 11:53:22.083110 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:53:22.083110 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:53:22.083110 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 11:53:22.083110 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 11:53:22.083110 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 11:53:22.083110 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 11:53:22.083110 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 25 11:53:22.083110 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 25 11:53:22.085323 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 25 11:53:22.085323 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 25 11:53:22.085323 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 25 11:53:22.085323 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 25 11:53:22.085323 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 25 11:53:22.085323 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:53:22.085323 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 396/803] 10.222.0.44 () {60 vars in 1131 bytes} [Wed May 25 11:53:21 2022] POST /identity/v3/users => generated 160 bytes in 164 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 25 11:53:22.086402 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da9d967-5607-4c31-a6e2-528310cc9aec None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:22.165755 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4cb8a9-c652-4576-aadd-958f13823c7e None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:22.166049 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4cb8a9-c652-4576-aadd-958f13823c7e None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:22.166326 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4cb8a9-c652-4576-aadd-958f13823c7e None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:22.170737 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 397/804] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:53:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 11:53:22.175883 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b841a3f-19b9-45aa-8df7-1a1ce37cc646 None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:22.176177 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b841a3f-19b9-45aa-8df7-1a1ce37cc646 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:22.176455 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b841a3f-19b9-45aa-8df7-1a1ce37cc646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:22.180404 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da9d967-5607-4c31-a6e2-528310cc9aec None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:22.193278 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-9b841a3f-19b9-45aa-8df7-1a1ce37cc646 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:53:22.194780 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-9b841a3f-19b9-45aa-8df7-1a1ce37cc646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:53:22.215497 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5902cc-93ac-4021-ba31-04e8db04246b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:22.216333 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5902cc-93ac-4021-ba31-04e8db04246b None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:22.216613 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5902cc-93ac-4021-ba31-04e8db04246b None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:22.216887 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5902cc-93ac-4021-ba31-04e8db04246b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:22.223998 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5902cc-93ac-4021-ba31-04e8db04246b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:22.224200 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:22.225438 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5902cc-93ac-4021-ba31-04e8db04246b None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:22.240116 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-bf5902cc-93ac-4021-ba31-04e8db04246b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 25 11:53:22.240116 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:53:22.240116 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:53:22.240116 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:53:22.240116 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:53:22.240116 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:53:22.240116 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:53:22.240116 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:53:22.240116 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:53:22.240116 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:53:22.240116 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:53:22.240116 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:53:22.240116 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 11:53:22.240116 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 11:53:22.240116 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 11:53:22.240116 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 11:53:22.241228 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:53:22.241228 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:53:22.241228 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 11:53:22.241228 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 11:53:22.241228 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 11:53:22.241228 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 11:53:22.241228 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:53:22.241228 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:53:22.241228 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:53:22.241228 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:53:22.241228 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:53:22.241228 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:53:22.241228 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:53:22.241228 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:53:22.241228 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:53:22.241228 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:53:22.241228 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:53:22.241228 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:53:22.242618 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:53:22.242618 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:53:22.242618 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 11:53:22.242618 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 11:53:22.242618 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 11:53:22.242618 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 11:53:22.242618 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 11:53:22.242618 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 11:53:22.242618 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 25 11:53:22.242618 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:53:22.242618 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 408/805] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 25 11:53:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:53:22.246899 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5902cc-93ac-4021-ba31-04e8db04246b None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:22.266315 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 398/806] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:53:22 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 11:53:22.289885 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b841a3f-19b9-45aa-8df7-1a1ce37cc646 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:22.294910 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:22.344267 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5902cc-93ac-4021-ba31-04e8db04246b None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:22.376515 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69227f-1abb-48fe-b714-761afcc16025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:22.377176 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69227f-1abb-48fe-b714-761afcc16025 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:22.377464 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69227f-1abb-48fe-b714-761afcc16025 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:22.377735 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69227f-1abb-48fe-b714-761afcc16025 None admin] PATH_INFO: `/v3/users` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:22.378516 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b69227f-1abb-48fe-b714-761afcc16025 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:53:22.378820 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b69227f-1abb-48fe-b714-761afcc16025 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:22.380278 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b69227f-1abb-48fe-b714-761afcc16025 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:22.384364 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b841a3f-19b9-45aa-8df7-1a1ce37cc646 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:22.415172 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 409/807] 10.222.0.44 () {56 vars in 1101 bytes} [Wed May 25 11:53:22 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:53:22.417608 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e07dfe-2c6d-4d32-a314-c1c9aa93e07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:22.418285 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e07dfe-2c6d-4d32-a314-c1c9aa93e07e None admin] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:22.418574 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e07dfe-2c6d-4d32-a314-c1c9aa93e07e None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:22.418852 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e07dfe-2c6d-4d32-a314-c1c9aa93e07e None admin] PATH_INFO: `/v3/services` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:22.419579 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e07dfe-2c6d-4d32-a314-c1c9aa93e07e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:22.421153 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e07dfe-2c6d-4d32-a314-c1c9aa93e07e None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:22.436401 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 399/808] 10.222.0.44 () {60 vars in 1141 bytes} [Wed May 25 11:53:22 2022] POST /identity/v3/services => generated 242 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 11:53:24.715119 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce30113c-6df4-47ee-885b-c2cc4dad7982 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:24.715631 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce30113c-6df4-47ee-885b-c2cc4dad7982 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:24.715723 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce30113c-6df4-47ee-885b-c2cc4dad7982 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:24.717048 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 410/809] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:53:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:53:24.722281 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06deee13-5e7a-498d-adc4-46d9ef86e478 None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:24.722697 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06deee13-5e7a-498d-adc4-46d9ef86e478 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:24.722842 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06deee13-5e7a-498d-adc4-46d9ef86e478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:24.739695 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-06deee13-5e7a-498d-adc4-46d9ef86e478 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:53:24.740903 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-06deee13-5e7a-498d-adc4-46d9ef86e478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:53:24.759862 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:24.810539 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 400/810] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:53:24 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 11:53:24.833622 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce30113c-6df4-47ee-885b-c2cc4dad7982 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:24.937611 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce30113c-6df4-47ee-885b-c2cc4dad7982 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:24.944772 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:24.975705 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d576a5-ed44-471b-9ece-24e8d28851a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:24.977079 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d576a5-ed44-471b-9ece-24e8d28851a0 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:24.977361 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d576a5-ed44-471b-9ece-24e8d28851a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:24.977636 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d576a5-ed44-471b-9ece-24e8d28851a0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:24.978286 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d576a5-ed44-471b-9ece-24e8d28851a0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:24.979659 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d576a5-ed44-471b-9ece-24e8d28851a0 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:24.991304 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-b5d576a5-ed44-471b-9ece-24e8d28851a0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 25 11:53:24.991304 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:53:24.991304 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 11:53:24.991304 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 11:53:24.991304 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 11:53:24.991304 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 11:53:24.991304 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 11:53:24.991304 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 11:53:24.991304 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 11:53:24.991304 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:53:24.991304 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 11:53:24.991304 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:53:24.991304 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:53:24.991304 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:53:24.991304 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:53:24.991304 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:53:24.991304 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:53:24.992423 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:53:24.992423 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:53:24.992423 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:53:24.992423 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:53:24.992423 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:53:24.992423 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:53:24.992423 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 11:53:24.992423 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 11:53:24.992423 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 11:53:24.992423 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 11:53:24.992423 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:53:24.992423 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:53:24.992423 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:53:24.992423 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:53:24.992423 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:53:24.992423 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:53:24.993286 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:53:24.993286 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:53:24.993286 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:53:24.993286 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:53:24.993286 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:53:24.993286 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:53:24.993286 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:53:24.993286 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:53:24.993286 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:53:24.993286 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:53:24.993286 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 11:53:24.993286 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 11:53:24.993286 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 11:53:24.993286 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:53:24.993286 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 411/811] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 25 11:53:24 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:53:24.999896 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06deee13-5e7a-498d-adc4-46d9ef86e478 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:25.095475 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06deee13-5e7a-498d-adc4-46d9ef86e478 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:25.128315 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ac12a-eeaf-4523-8cd2-006c384bfb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:25.128963 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ac12a-eeaf-4523-8cd2-006c384bfb72 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:25.129243 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ac12a-eeaf-4523-8cd2-006c384bfb72 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:25.129518 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ac12a-eeaf-4523-8cd2-006c384bfb72 None admin] PATH_INFO: `/v3/services` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:25.130214 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008ac12a-eeaf-4523-8cd2-006c384bfb72 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:53:25.130519 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008ac12a-eeaf-4523-8cd2-006c384bfb72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:25.131906 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008ac12a-eeaf-4523-8cd2-006c384bfb72 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:25.137083 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 401/812] 10.222.0.44 () {56 vars in 1112 bytes} [Wed May 25 11:53:24 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:53:25.142899 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d576a5-ed44-471b-9ece-24e8d28851a0 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:25.239429 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d576a5-ed44-471b-9ece-24e8d28851a0 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:25.271684 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9849a8-442a-4384-9e3c-94fddd21dd6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:25.272367 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9849a8-442a-4384-9e3c-94fddd21dd6b None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:25.272653 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9849a8-442a-4384-9e3c-94fddd21dd6b None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:25.272931 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9849a8-442a-4384-9e3c-94fddd21dd6b None admin] PATH_INFO: `/v3/services` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:25.274202 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9849a8-442a-4384-9e3c-94fddd21dd6b None admin] RBAC: Adding query filter params (type=compute) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:53:25.274513 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9849a8-442a-4384-9e3c-94fddd21dd6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:25.275905 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9849a8-442a-4384-9e3c-94fddd21dd6b None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:25.280574 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 412/813] 10.222.0.44 () {56 vars in 1112 bytes} [Wed May 25 11:53:25 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:53:25.286467 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ac12a-eeaf-4523-8cd2-006c384bfb72 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:25.303923 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:25.403208 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ac12a-eeaf-4523-8cd2-006c384bfb72 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:25.435203 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0001111-ecab-42bd-b6b3-f972f1acdcc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:25.435875 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0001111-ecab-42bd-b6b3-f972f1acdcc7 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:25.436163 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0001111-ecab-42bd-b6b3-f972f1acdcc7 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:25.436436 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0001111-ecab-42bd-b6b3-f972f1acdcc7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:25.437207 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0001111-ecab-42bd-b6b3-f972f1acdcc7 None admin] RBAC: Adding query filter params (interface=public, service_id=b39d0959432b48588bc78b02f5abfee4, region_id=RegionOne) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:53:25.437515 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0001111-ecab-42bd-b6b3-f972f1acdcc7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:25.438872 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0001111-ecab-42bd-b6b3-f972f1acdcc7 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:25.443663 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 402/814] 10.222.0.44 () {56 vars in 1251 bytes} [Wed May 25 11:53:25 2022] GET /identity/v3/endpoints?service_id=b39d0959432b48588bc78b02f5abfee4&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:53:25.449965 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9849a8-442a-4384-9e3c-94fddd21dd6b None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:25.482744 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:25.545758 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9849a8-442a-4384-9e3c-94fddd21dd6b None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:25.577991 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49070b3-6a96-46da-95ec-6340b93319f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:25.578652 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49070b3-6a96-46da-95ec-6340b93319f1 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:25.578929 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49070b3-6a96-46da-95ec-6340b93319f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:25.579207 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49070b3-6a96-46da-95ec-6340b93319f1 None admin] PATH_INFO: `/v3/services` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:25.579904 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49070b3-6a96-46da-95ec-6340b93319f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:25.581272 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49070b3-6a96-46da-95ec-6340b93319f1 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:25.587252 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 413/815] 10.222.0.44 () {56 vars in 1087 bytes} [Wed May 25 11:53:25 2022] GET /identity/v3/services => generated 1728 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 11:53:27.875369 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97e8af-1daf-44e0-8e9a-4d9527d4ce31 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:27.876178 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97e8af-1daf-44e0-8e9a-4d9527d4ce31 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:27.876178 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97e8af-1daf-44e0-8e9a-4d9527d4ce31 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:27.877378 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 403/816] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:53:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:53:27.883512 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f68be-c212-4e49-8318-b085e02deca9 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:27.883960 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f68be-c212-4e49-8318-b085e02deca9 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:27.884102 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f68be-c212-4e49-8318-b085e02deca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:27.901471 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-5b2f68be-c212-4e49-8318-b085e02deca9 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:53:27.902645 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-5b2f68be-c212-4e49-8318-b085e02deca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:53:27.965589 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 414/817] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:53:27 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 11:53:27.990449 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c97e8af-1daf-44e0-8e9a-4d9527d4ce31 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:28.071664 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:28.091862 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c97e8af-1daf-44e0-8e9a-4d9527d4ce31 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:28.124019 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cdab70-306d-4357-9918-f27736a5dc9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:28.124811 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cdab70-306d-4357-9918-f27736a5dc9c None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:28.125097 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cdab70-306d-4357-9918-f27736a5dc9c None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:28.125426 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cdab70-306d-4357-9918-f27736a5dc9c None admin] PATH_INFO: `/v3/services/compute` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:28.126024 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cdab70-306d-4357-9918-f27736a5dc9c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:28.127391 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cdab70-306d-4357-9918-f27736a5dc9c None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:28.139731 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-f5cdab70-306d-4357-9918-f27736a5dc9c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 25 11:53:28.139731 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:53:28.139731 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 11:53:28.139731 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 11:53:28.139731 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 11:53:28.139731 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 11:53:28.139731 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 11:53:28.139731 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 11:53:28.139731 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 11:53:28.139731 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:53:28.139731 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 11:53:28.139731 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:53:28.139731 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:53:28.139731 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:53:28.139731 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:53:28.139731 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:53:28.139731 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:53:28.140945 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:53:28.140945 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:53:28.140945 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:53:28.140945 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:53:28.140945 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:53:28.140945 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:53:28.140945 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 11:53:28.140945 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 11:53:28.140945 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 11:53:28.140945 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 11:53:28.140945 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:53:28.140945 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:53:28.140945 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:53:28.140945 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:53:28.140945 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:53:28.140945 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:53:28.141825 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:53:28.141825 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:53:28.141825 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:53:28.141825 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:53:28.141825 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:53:28.141825 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:53:28.141825 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:53:28.141825 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:53:28.141825 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:53:28.141825 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:53:28.141825 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 11:53:28.141825 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 11:53:28.141825 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 11:53:28.141825 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:53:28.141825 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 404/818] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 25 11:53:27 2022] GET /identity/v3/services/compute => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:53:28.149150 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f68be-c212-4e49-8318-b085e02deca9 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:28.175468 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:28.243628 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f68be-c212-4e49-8318-b085e02deca9 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:28.276497 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a05bc-585f-483c-9932-2fa802479afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:28.277152 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a05bc-585f-483c-9932-2fa802479afb None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:28.277433 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a05bc-585f-483c-9932-2fa802479afb None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:28.277706 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a05bc-585f-483c-9932-2fa802479afb None admin] PATH_INFO: `/v3/services` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:28.278401 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8a05bc-585f-483c-9932-2fa802479afb None admin] RBAC: Adding query filter params (name=compute) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:53:28.278709 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8a05bc-585f-483c-9932-2fa802479afb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:28.280091 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8a05bc-585f-483c-9932-2fa802479afb None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:28.284650 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 415/819] 10.222.0.44 () {56 vars in 1112 bytes} [Wed May 25 11:53:28 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:53:28.290520 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cdab70-306d-4357-9918-f27736a5dc9c None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:28.384648 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cdab70-306d-4357-9918-f27736a5dc9c None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:28.416337 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc661c8-3158-41c6-b9d0-f874da512af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:28.416985 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc661c8-3158-41c6-b9d0-f874da512af7 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:28.417267 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc661c8-3158-41c6-b9d0-f874da512af7 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:28.417540 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc661c8-3158-41c6-b9d0-f874da512af7 None admin] PATH_INFO: `/v3/services` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:28.418228 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc661c8-3158-41c6-b9d0-f874da512af7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:53:28.418531 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc661c8-3158-41c6-b9d0-f874da512af7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:28.419913 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc661c8-3158-41c6-b9d0-f874da512af7 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:28.424519 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 405/820] 10.222.0.44 () {56 vars in 1112 bytes} [Wed May 25 11:53:28 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:53:28.430818 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a05bc-585f-483c-9932-2fa802479afb None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:53:28.518468 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:28.527466 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a05bc-585f-483c-9932-2fa802479afb None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:53:28.559886 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b057cad-e43b-4cd9-ae5d-769f18e623ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:53:28.560524 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b057cad-e43b-4cd9-ae5d-769f18e623ae None admin] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:53:28.560809 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b057cad-e43b-4cd9-ae5d-769f18e623ae None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:53:28.561081 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b057cad-e43b-4cd9-ae5d-769f18e623ae None admin] PATH_INFO: `/v3/endpoints` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:53:28.561811 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b057cad-e43b-4cd9-ae5d-769f18e623ae None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:53:28.563156 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b057cad-e43b-4cd9-ae5d-769f18e623ae None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:53:28.580642 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 416/821] 10.222.0.44 () {60 vars in 1144 bytes} [Wed May 25 11:53:28 2022] POST /identity/v3/endpoints => generated 334 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 11:53:38.422116 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=96 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:53:38.576430 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=25,keystone:INSERT=1 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:54:30.344596 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2509b-f088-4fed-b7f3-dd2fbf0eae16 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:30.345208 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2509b-f088-4fed-b7f3-dd2fbf0eae16 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:30.345208 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2509b-f088-4fed-b7f3-dd2fbf0eae16 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:30.346519 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 406/822] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:54:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:54:30.353852 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cfcf47-83a3-4104-838a-7e606d9f39cb None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:30.354417 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cfcf47-83a3-4104-838a-7e606d9f39cb None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:30.354523 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cfcf47-83a3-4104-838a-7e606d9f39cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:30.373677 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-83cfcf47-83a3-4104-838a-7e606d9f39cb None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:54:30.375135 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-83cfcf47-83a3-4104-838a-7e606d9f39cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:54:30.463919 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 417/823] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:54:30 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 11:54:30.492123 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a2509b-f088-4fed-b7f3-dd2fbf0eae16 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:30.618826 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a2509b-f088-4fed-b7f3-dd2fbf0eae16 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:30.654503 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bbcf53-1f39-4673-bc24-370ffb2029b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:30.655266 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bbcf53-1f39-4673-bc24-370ffb2029b6 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:30.655571 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bbcf53-1f39-4673-bc24-370ffb2029b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:30.655955 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bbcf53-1f39-4673-bc24-370ffb2029b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:30.666939 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bbcf53-1f39-4673-bc24-370ffb2029b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:30.668419 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bbcf53-1f39-4673-bc24-370ffb2029b6 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:30.689524 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-60bbcf53-1f39-4673-bc24-370ffb2029b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:54:30.689524 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:54:30.689524 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:54:30.689524 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:54:30.689524 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:54:30.689524 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:54:30.689524 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:54:30.689524 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:54:30.689524 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:54:30.689524 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:54:30.689524 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:54:30.689524 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:54:30.689524 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 11:54:30.689524 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 11:54:30.689524 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 11:54:30.691181 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 11:54:30.691181 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:54:30.691181 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:54:30.691181 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:54:30.691181 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:54:30.691181 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:54:30.691181 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:54:30.691181 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:54:30.691181 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:54:30.691181 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:54:30.691181 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:54:30.691181 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:54:30.691181 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:54:30.691181 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:54:30.691181 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:54:30.691181 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:54:30.691181 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:54:30.692511 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 11:54:30.692511 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 11:54:30.692511 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:54:30.692511 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:54:30.692511 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 407/824] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:54:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:54:30.697103 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cfcf47-83a3-4104-838a-7e606d9f39cb None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:30.829451 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cfcf47-83a3-4104-838a-7e606d9f39cb None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:30.863933 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:54:30.876125 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91df0844-025e-4302-b7bf-6c31157c5e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:30.876948 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df0844-025e-4302-b7bf-6c31157c5e12 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:30.877334 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df0844-025e-4302-b7bf-6c31157c5e12 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:30.877787 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df0844-025e-4302-b7bf-6c31157c5e12 None admin] PATH_INFO: `/v3/domains` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:30.878521 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91df0844-025e-4302-b7bf-6c31157c5e12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:54:30.878926 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91df0844-025e-4302-b7bf-6c31157c5e12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:30.880531 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91df0844-025e-4302-b7bf-6c31157c5e12 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:30.901351 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 418/825] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 25 11:54:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:54:30.902454 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bbcf53-1f39-4673-bc24-370ffb2029b6 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:30.963143 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:54:31.018844 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bbcf53-1f39-4673-bc24-370ffb2029b6 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:31.075276 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b6e98c-fcd3-4db7-b1ee-13a5bb4dbad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:31.076375 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6e98c-fcd3-4db7-b1ee-13a5bb4dbad5 None admin] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:31.076861 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6e98c-fcd3-4db7-b1ee-13a5bb4dbad5 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:31.077346 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6e98c-fcd3-4db7-b1ee-13a5bb4dbad5 None admin] PATH_INFO: `/v3/users` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:31.078637 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b6e98c-fcd3-4db7-b1ee-13a5bb4dbad5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:31.081017 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b6e98c-fcd3-4db7-b1ee-13a5bb4dbad5 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:31.123826 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 408/826] 10.222.0.44 () {60 vars in 1132 bytes} [Wed May 25 11:54:30 2022] POST /identity/v3/users => generated 251 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 11:54:33.654591 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491bd1a-6691-49de-9f6d-2eed0b4fd760 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:33.655142 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491bd1a-6691-49de-9f6d-2eed0b4fd760 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:33.655142 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491bd1a-6691-49de-9f6d-2eed0b4fd760 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:33.657252 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 419/827] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:54:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:54:33.662456 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1770ff1-da26-4789-9505-d13faf1a6096 None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:33.663154 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1770ff1-da26-4789-9505-d13faf1a6096 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:33.663154 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1770ff1-da26-4789-9505-d13faf1a6096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:33.682552 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-c1770ff1-da26-4789-9505-d13faf1a6096 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:54:33.683824 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-c1770ff1-da26-4789-9505-d13faf1a6096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:54:33.760599 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 409/828] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:54:33 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 11:54:33.789016 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3491bd1a-6691-49de-9f6d-2eed0b4fd760 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:33.906978 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3491bd1a-6691-49de-9f6d-2eed0b4fd760 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:33.941979 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c1edf8-fe9b-40ee-a595-48928b0979d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:33.942775 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1edf8-fe9b-40ee-a595-48928b0979d4 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:33.943058 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1edf8-fe9b-40ee-a595-48928b0979d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:33.943336 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1edf8-fe9b-40ee-a595-48928b0979d4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:33.954717 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c1edf8-fe9b-40ee-a595-48928b0979d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:54:33.963668 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-f5c1edf8-fe9b-40ee-a595-48928b0979d4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 11:54:33.963668 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:54:33.963668 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:54:33.963668 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:54:33.963668 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:54:33.963668 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:54:33.963668 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:54:33.963668 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:54:33.963668 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:54:33.963668 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:54:33.963668 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:54:33.963668 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:54:33.963668 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:54:33.963668 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:54:33.963668 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:54:33.963668 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:54:33.964886 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:54:33.964886 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:54:33.964886 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:54:33.964886 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:54:33.964886 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:54:33.964886 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:54:33.964886 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:54:33.964886 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:54:33.964886 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:54:33.964886 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:54:33.964886 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:54:33.964886 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:54:33.964886 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:54:33.964886 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:54:33.964886 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:54:33.964886 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:54:33.966100 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:54:33.966100 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:54:33.966100 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:54:33.966100 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:54:33.966100 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:54:33.966100 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:54:33.966100 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:54:33.966100 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:54:33.966100 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:54:33.966100 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:54:33.966100 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 11:54:33.966100 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:54:33.966100 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 420/829] 10.222.0.44 () {56 vars in 1102 bytes} [Wed May 25 11:54:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:54:33.971134 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1770ff1-da26-4789-9505-d13faf1a6096 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:34.014092 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:54:34.080409 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1770ff1-da26-4789-9505-d13faf1a6096 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:34.116141 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1267627c-6e89-453a-a221-264905dda476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:34.116813 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267627c-6e89-453a-a221-264905dda476 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:34.117096 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267627c-6e89-453a-a221-264905dda476 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:34.117373 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267627c-6e89-453a-a221-264905dda476 None admin] PATH_INFO: `/v3/roles` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:34.118120 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1267627c-6e89-453a-a221-264905dda476 None admin] RBAC: Adding query filter params (name=service) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:54:34.118427 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1267627c-6e89-453a-a221-264905dda476 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:34.119805 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1267627c-6e89-453a-a221-264905dda476 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:34.128846 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 410/830] 10.222.0.44 () {56 vars in 1103 bytes} [Wed May 25 11:54:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:54:34.135151 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c1edf8-fe9b-40ee-a595-48928b0979d4 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:34.189245 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:54:34.245944 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c1edf8-fe9b-40ee-a595-48928b0979d4 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:34.283783 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e17782-a8ed-421e-b24d-51409622b082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:34.284607 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e17782-a8ed-421e-b24d-51409622b082 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:34.284888 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e17782-a8ed-421e-b24d-51409622b082 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:34.285162 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e17782-a8ed-421e-b24d-51409622b082 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:34.295366 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e17782-a8ed-421e-b24d-51409622b082 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:34.296852 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e17782-a8ed-421e-b24d-51409622b082 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:34.315007 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-66e17782-a8ed-421e-b24d-51409622b082 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:54:34.315007 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:54:34.315007 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:54:34.315007 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:54:34.315007 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:54:34.315007 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:54:34.315007 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:54:34.315007 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:54:34.315007 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:54:34.315007 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:54:34.315007 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:54:34.315007 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:54:34.315007 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 11:54:34.315007 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 11:54:34.315007 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 11:54:34.316867 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 11:54:34.316867 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:54:34.316867 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:54:34.316867 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:54:34.316867 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:54:34.316867 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:54:34.316867 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:54:34.316867 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:54:34.316867 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:54:34.316867 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:54:34.316867 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:54:34.316867 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:54:34.316867 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:54:34.316867 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:54:34.316867 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:54:34.316867 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:54:34.316867 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:54:34.318860 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 11:54:34.318860 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 11:54:34.318860 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:54:34.318860 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:54:34.318860 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 421/831] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:54:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:54:34.322834 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1267627c-6e89-453a-a221-264905dda476 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:34.438915 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:54:34.442439 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1267627c-6e89-453a-a221-264905dda476 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:34.479292 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2428138c-7537-47a4-a973-7db9c981a26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:34.479992 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428138c-7537-47a4-a973-7db9c981a26b None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:34.480363 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428138c-7537-47a4-a973-7db9c981a26b None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:34.480640 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428138c-7537-47a4-a973-7db9c981a26b None admin] PATH_INFO: `/v3/domains` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:34.481578 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2428138c-7537-47a4-a973-7db9c981a26b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:54:34.481820 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2428138c-7537-47a4-a973-7db9c981a26b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:34.483576 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2428138c-7537-47a4-a973-7db9c981a26b None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:34.497059 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 411/832] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 25 11:54:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:54:34.502998 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e17782-a8ed-421e-b24d-51409622b082 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:34.611338 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:54:34.616606 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e17782-a8ed-421e-b24d-51409622b082 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:34.654878 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c4e11a-b7b4-4e7e-a359-147de7600559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:34.655721 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c4e11a-b7b4-4e7e-a359-147de7600559 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:34.656045 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c4e11a-b7b4-4e7e-a359-147de7600559 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:34.656308 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c4e11a-b7b4-4e7e-a359-147de7600559 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:34.664538 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c4e11a-b7b4-4e7e-a359-147de7600559 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:34.665964 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c4e11a-b7b4-4e7e-a359-147de7600559 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:34.682458 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-89c4e11a-b7b4-4e7e-a359-147de7600559 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 11:54:34.682458 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:54:34.682458 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:54:34.682458 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:54:34.682458 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:54:34.682458 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:54:34.682458 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:54:34.682458 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:54:34.682458 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:54:34.682458 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:54:34.682458 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:54:34.682458 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:54:34.682458 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 11:54:34.682458 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 11:54:34.682458 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 11:54:34.682458 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 11:54:34.683706 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:54:34.683706 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:54:34.683706 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 11:54:34.683706 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 11:54:34.683706 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 11:54:34.683706 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 11:54:34.683706 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:54:34.683706 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:54:34.683706 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:54:34.683706 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:54:34.683706 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:54:34.683706 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:54:34.683706 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:54:34.683706 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:54:34.683706 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:54:34.683706 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:54:34.683706 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:54:34.683706 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:54:34.689394 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:54:34.689394 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:54:34.689394 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 11:54:34.689394 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 11:54:34.689394 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 11:54:34.689394 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 11:54:34.689394 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 11:54:34.689394 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 11:54:34.689394 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 11:54:34.689394 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:54:34.689394 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 422/833] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:54:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:54:34.690147 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2428138c-7537-47a4-a973-7db9c981a26b None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:34.800561 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2428138c-7537-47a4-a973-7db9c981a26b None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:34.839461 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba6f7e-08a3-4e34-a501-926591ba2ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:34.840307 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba6f7e-08a3-4e34-a501-926591ba2ec0 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:34.840611 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba6f7e-08a3-4e34-a501-926591ba2ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:34.840942 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba6f7e-08a3-4e34-a501-926591ba2ec0 None admin] PATH_INFO: `/v3/users` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:34.841904 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dba6f7e-08a3-4e34-a501-926591ba2ec0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:54:34.842216 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dba6f7e-08a3-4e34-a501-926591ba2ec0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:34.843858 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dba6f7e-08a3-4e34-a501-926591ba2ec0 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:34.863451 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 412/834] 10.222.0.44 () {56 vars in 1143 bytes} [Wed May 25 11:54:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:54:34.870157 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c4e11a-b7b4-4e7e-a359-147de7600559 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:34.975996 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c4e11a-b7b4-4e7e-a359-147de7600559 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:35.011918 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f849b0a1-a04e-43bc-95fb-01a8cfc0c2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:35.012587 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f849b0a1-a04e-43bc-95fb-01a8cfc0c2ab None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:35.013020 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f849b0a1-a04e-43bc-95fb-01a8cfc0c2ab None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:35.013213 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f849b0a1-a04e-43bc-95fb-01a8cfc0c2ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:35.042815 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:54:35.091553 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f849b0a1-a04e-43bc-95fb-01a8cfc0c2ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:35.093185 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f849b0a1-a04e-43bc-95fb-01a8cfc0c2ab None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:35.201282 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 423/835] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 25 11:54:34 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 11:54:35.207172 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba6f7e-08a3-4e34-a501-926591ba2ec0 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:35.227777 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:54:35.313747 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba6f7e-08a3-4e34-a501-926591ba2ec0 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:35.349413 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d529e58-3b21-45a4-9202-09dab49dc997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:35.350205 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d529e58-3b21-45a4-9202-09dab49dc997 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:35.350487 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d529e58-3b21-45a4-9202-09dab49dc997 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:35.350761 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d529e58-3b21-45a4-9202-09dab49dc997 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:35.361668 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d529e58-3b21-45a4-9202-09dab49dc997 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:35.363275 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d529e58-3b21-45a4-9202-09dab49dc997 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:35.384117 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-9d529e58-3b21-45a4-9202-09dab49dc997 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:54:35.384117 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:54:35.384117 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:54:35.384117 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:54:35.384117 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:54:35.384117 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:54:35.384117 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:54:35.384117 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:54:35.384117 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:54:35.384117 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:54:35.384117 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:54:35.384117 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:54:35.384117 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 11:54:35.384117 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 11:54:35.384117 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 11:54:35.385092 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 11:54:35.385092 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:54:35.385092 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:54:35.385092 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:54:35.385092 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:54:35.385092 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:54:35.385092 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:54:35.385092 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:54:35.385092 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:54:35.385092 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:54:35.385092 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:54:35.385092 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:54:35.385092 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:54:35.385092 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:54:35.385092 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:54:35.385092 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:54:35.385092 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:54:35.385982 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 11:54:35.385982 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 11:54:35.385982 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:54:35.385982 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:54:35.388893 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 413/836] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:54:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 11:54:35.395654 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f849b0a1-a04e-43bc-95fb-01a8cfc0c2ab None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:35.457179 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:54:35.504060 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f849b0a1-a04e-43bc-95fb-01a8cfc0c2ab None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:35.542092 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a8f71-4df9-4135-a3f1-5b6f9c418b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:35.542935 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a8f71-4df9-4135-a3f1-5b6f9c418b1d None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:35.543223 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a8f71-4df9-4135-a3f1-5b6f9c418b1d None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:35.543508 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a8f71-4df9-4135-a3f1-5b6f9c418b1d None admin] PATH_INFO: `/v3/domains` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:35.544273 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735a8f71-4df9-4135-a3f1-5b6f9c418b1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:54:35.544586 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735a8f71-4df9-4135-a3f1-5b6f9c418b1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:35.546130 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735a8f71-4df9-4135-a3f1-5b6f9c418b1d None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:35.558911 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 424/837] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 25 11:54:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:54:35.564848 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d529e58-3b21-45a4-9202-09dab49dc997 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:35.643965 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:54:35.683368 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d529e58-3b21-45a4-9202-09dab49dc997 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:35.718885 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bab0b4-cf00-4033-bf09-1f2fe89dce11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:35.719665 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bab0b4-cf00-4033-bf09-1f2fe89dce11 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:35.719986 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bab0b4-cf00-4033-bf09-1f2fe89dce11 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:35.720265 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bab0b4-cf00-4033-bf09-1f2fe89dce11 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:35.727269 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bab0b4-cf00-4033-bf09-1f2fe89dce11 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:35.728743 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bab0b4-cf00-4033-bf09-1f2fe89dce11 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:35.743920 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-c9bab0b4-cf00-4033-bf09-1f2fe89dce11 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 11:54:35.743920 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:54:35.743920 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:54:35.743920 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:54:35.743920 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:54:35.743920 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:54:35.743920 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:54:35.743920 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:54:35.743920 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:54:35.743920 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:54:35.743920 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:54:35.743920 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:54:35.743920 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 11:54:35.743920 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 11:54:35.743920 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 11:54:35.745089 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 11:54:35.745089 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:54:35.745089 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:54:35.745089 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:54:35.745089 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:54:35.745089 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:54:35.745089 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:54:35.745089 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:54:35.745089 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:54:35.745089 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:54:35.745089 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:54:35.745089 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:54:35.745089 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:54:35.745089 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:54:35.745089 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:54:35.745089 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:54:35.745089 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:54:35.746043 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 11:54:35.746043 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 11:54:35.746043 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 11:54:35.746043 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 11:54:35.746043 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 11:54:35.746043 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 11:54:35.746043 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 11:54:35.746043 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:54:35.746043 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 414/838] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 25 11:54:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:54:35.751385 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a8f71-4df9-4135-a3f1-5b6f9c418b1d None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:35.862024 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a8f71-4df9-4135-a3f1-5b6f9c418b1d None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:35.881344 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:54:35.904671 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2ce6a-fa52-48f2-a9ce-bec8356cd9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:35.905397 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2ce6a-fa52-48f2-a9ce-bec8356cd9c8 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:35.905681 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2ce6a-fa52-48f2-a9ce-bec8356cd9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:35.906028 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2ce6a-fa52-48f2-a9ce-bec8356cd9c8 None admin] PATH_INFO: `/v3/projects` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:35.907014 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a2ce6a-fa52-48f2-a9ce-bec8356cd9c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:54:35.907270 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a2ce6a-fa52-48f2-a9ce-bec8356cd9c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:35.908965 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a2ce6a-fa52-48f2-a9ce-bec8356cd9c8 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:35.925022 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 425/839] 10.222.0.44 () {56 vars in 1148 bytes} [Wed May 25 11:54:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:54:35.931687 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bab0b4-cf00-4033-bf09-1f2fe89dce11 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:36.044847 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bab0b4-cf00-4033-bf09-1f2fe89dce11 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:36.075964 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:54:36.082556 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3384c4be-76ba-40b5-b213-47e019f8af19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:36.083897 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384c4be-76ba-40b5-b213-47e019f8af19 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:36.084300 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384c4be-76ba-40b5-b213-47e019f8af19 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:36.084874 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384c4be-76ba-40b5-b213-47e019f8af19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:36.085792 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3384c4be-76ba-40b5-b213-47e019f8af19 None admin] RBAC: Adding query filter params (role.id=33fd4a41fa554c6699a6c832f8eb793e, scope.project.id=57e08d47948142978437098a8120be78, user.id=94f4a0c602a7495dbb36dd768cc55a47) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:54:36.086224 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3384c4be-76ba-40b5-b213-47e019f8af19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:36.087819 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3384c4be-76ba-40b5-b213-47e019f8af19 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:36.093715 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 415/840] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 25 11:54:35 2022] GET /identity/v3/role_assignments?user.id=94f4a0c602a7495dbb36dd768cc55a47&scope.project.id=57e08d47948142978437098a8120be78&role.id=33fd4a41fa554c6699a6c832f8eb793e => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:54:38.485236 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f6eb1-521b-4313-853b-79aa72946bac None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:38.485779 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f6eb1-521b-4313-853b-79aa72946bac None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:38.485779 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f6eb1-521b-4313-853b-79aa72946bac None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:38.487046 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 426/841] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:54:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:54:38.492192 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738293d7-d9d7-4018-923b-84cfd9552c80 None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:38.492645 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738293d7-d9d7-4018-923b-84cfd9552c80 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:38.492741 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738293d7-d9d7-4018-923b-84cfd9552c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:38.509322 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-738293d7-d9d7-4018-923b-84cfd9552c80 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:54:38.510494 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-738293d7-d9d7-4018-923b-84cfd9552c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:54:38.579072 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 416/842] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:54:38 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 11:54:38.602660 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f6eb1-521b-4313-853b-79aa72946bac None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:38.711149 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f6eb1-521b-4313-853b-79aa72946bac None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:38.747815 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dea244-37fc-4f7e-bc4a-cd7b7a3fdd5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:38.748611 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dea244-37fc-4f7e-bc4a-cd7b7a3fdd5f None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:38.748899 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dea244-37fc-4f7e-bc4a-cd7b7a3fdd5f None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:38.749175 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dea244-37fc-4f7e-bc4a-cd7b7a3fdd5f None admin] PATH_INFO: `/v3/roles/service` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:38.760941 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dea244-37fc-4f7e-bc4a-cd7b7a3fdd5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:54:38.771305 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-50dea244-37fc-4f7e-bc4a-cd7b7a3fdd5f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 11:54:38.771305 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:54:38.771305 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:54:38.771305 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:54:38.771305 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:54:38.771305 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:54:38.771305 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:54:38.771305 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:54:38.771305 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:54:38.771305 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:54:38.771305 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:54:38.771305 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:54:38.771305 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:54:38.771305 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:54:38.771305 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:54:38.771305 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:54:38.772628 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:54:38.772628 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:54:38.772628 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:54:38.772628 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:54:38.772628 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:54:38.772628 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:54:38.772628 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:54:38.772628 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:54:38.772628 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:54:38.772628 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:54:38.772628 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:54:38.772628 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:54:38.772628 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:54:38.772628 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:54:38.772628 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:54:38.772628 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:54:38.773583 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:54:38.773583 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:54:38.773583 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:54:38.773583 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:54:38.773583 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:54:38.773583 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:54:38.773583 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:54:38.773583 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:54:38.773583 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:54:38.773583 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:54:38.773583 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 11:54:38.773583 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:54:38.773583 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 427/843] 10.222.0.44 () {56 vars in 1102 bytes} [Wed May 25 11:54:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:54:38.779145 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738293d7-d9d7-4018-923b-84cfd9552c80 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:38.890962 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738293d7-d9d7-4018-923b-84cfd9552c80 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:38.924219 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:54:38.936808 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea14260-acd0-4ea7-b0ba-48f98a23b281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:38.937536 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea14260-acd0-4ea7-b0ba-48f98a23b281 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:38.937841 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea14260-acd0-4ea7-b0ba-48f98a23b281 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:38.938107 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea14260-acd0-4ea7-b0ba-48f98a23b281 None admin] PATH_INFO: `/v3/roles` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:38.938918 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea14260-acd0-4ea7-b0ba-48f98a23b281 None admin] RBAC: Adding query filter params (name=service) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:54:38.939295 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea14260-acd0-4ea7-b0ba-48f98a23b281 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:38.940771 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea14260-acd0-4ea7-b0ba-48f98a23b281 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:38.949947 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 417/844] 10.222.0.44 () {56 vars in 1103 bytes} [Wed May 25 11:54:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:54:38.957764 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dea244-37fc-4f7e-bc4a-cd7b7a3fdd5f None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:39.007679 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:54:39.071493 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dea244-37fc-4f7e-bc4a-cd7b7a3fdd5f None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:39.108991 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb820180-2de7-4ca7-812a-116d399e6f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:39.109885 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb820180-2de7-4ca7-812a-116d399e6f22 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:39.110203 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb820180-2de7-4ca7-812a-116d399e6f22 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:39.110487 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb820180-2de7-4ca7-812a-116d399e6f22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:39.121941 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb820180-2de7-4ca7-812a-116d399e6f22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:39.123472 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb820180-2de7-4ca7-812a-116d399e6f22 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:39.141081 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-eb820180-2de7-4ca7-812a-116d399e6f22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:54:39.141081 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:54:39.141081 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:54:39.141081 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:54:39.141081 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:54:39.141081 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:54:39.141081 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:54:39.141081 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:54:39.141081 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:54:39.141081 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:54:39.141081 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:54:39.141081 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:54:39.141081 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 11:54:39.141081 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 11:54:39.141081 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 11:54:39.142190 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 11:54:39.142190 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:54:39.142190 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:54:39.142190 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:54:39.142190 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:54:39.142190 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:54:39.142190 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:54:39.142190 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:54:39.142190 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:54:39.142190 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:54:39.142190 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:54:39.142190 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:54:39.142190 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:54:39.142190 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:54:39.142190 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:54:39.142190 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:54:39.142190 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:54:39.143367 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 11:54:39.143367 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 11:54:39.143367 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:54:39.143367 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:54:39.143367 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 428/845] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:54:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:54:39.148352 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea14260-acd0-4ea7-b0ba-48f98a23b281 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:39.258009 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea14260-acd0-4ea7-b0ba-48f98a23b281 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:39.292847 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef503e3e-ce9d-4307-9376-e8f1d3177d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:39.293519 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef503e3e-ce9d-4307-9376-e8f1d3177d20 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:39.293817 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef503e3e-ce9d-4307-9376-e8f1d3177d20 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:39.294128 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef503e3e-ce9d-4307-9376-e8f1d3177d20 None admin] PATH_INFO: `/v3/domains` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:39.294836 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef503e3e-ce9d-4307-9376-e8f1d3177d20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:54:39.295139 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef503e3e-ce9d-4307-9376-e8f1d3177d20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:39.296659 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef503e3e-ce9d-4307-9376-e8f1d3177d20 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:39.309689 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 418/846] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 25 11:54:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:54:39.315403 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb820180-2de7-4ca7-812a-116d399e6f22 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:39.413262 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:54:39.425074 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb820180-2de7-4ca7-812a-116d399e6f22 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:39.459489 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f51429-a3c8-475a-b2da-4ed7a28670f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:39.460319 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f51429-a3c8-475a-b2da-4ed7a28670f4 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:39.460602 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f51429-a3c8-475a-b2da-4ed7a28670f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:39.461041 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f51429-a3c8-475a-b2da-4ed7a28670f4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:39.469989 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f51429-a3c8-475a-b2da-4ed7a28670f4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:39.471979 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f51429-a3c8-475a-b2da-4ed7a28670f4 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:39.489656 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-47f51429-a3c8-475a-b2da-4ed7a28670f4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 11:54:39.489656 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:54:39.489656 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:54:39.489656 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:54:39.489656 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:54:39.489656 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:54:39.489656 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:54:39.489656 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:54:39.489656 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:54:39.489656 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:54:39.489656 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:54:39.489656 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:54:39.489656 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 11:54:39.489656 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 11:54:39.489656 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 11:54:39.489656 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 11:54:39.491121 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:54:39.491121 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:54:39.491121 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 11:54:39.491121 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 11:54:39.491121 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 11:54:39.491121 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 11:54:39.491121 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:54:39.491121 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:54:39.491121 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:54:39.491121 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:54:39.491121 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:54:39.491121 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:54:39.491121 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:54:39.491121 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:54:39.491121 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:54:39.491121 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:54:39.491121 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:54:39.491121 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:54:39.492116 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:54:39.492116 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:54:39.492116 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 11:54:39.492116 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 11:54:39.492116 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 11:54:39.492116 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 11:54:39.492116 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 11:54:39.492116 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 11:54:39.492116 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 11:54:39.492116 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:54:39.492116 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 429/847] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:54:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:54:39.497212 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef503e3e-ce9d-4307-9376-e8f1d3177d20 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:39.548150 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:54:39.609187 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef503e3e-ce9d-4307-9376-e8f1d3177d20 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:39.649534 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6475536b-3e7c-4ecf-83e6-50704cb03fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:39.650208 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475536b-3e7c-4ecf-83e6-50704cb03fd7 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:39.650519 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475536b-3e7c-4ecf-83e6-50704cb03fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:39.650798 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475536b-3e7c-4ecf-83e6-50704cb03fd7 None admin] PATH_INFO: `/v3/users` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:39.651630 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6475536b-3e7c-4ecf-83e6-50704cb03fd7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:54:39.651969 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6475536b-3e7c-4ecf-83e6-50704cb03fd7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:39.653490 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6475536b-3e7c-4ecf-83e6-50704cb03fd7 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:39.677536 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 419/848] 10.222.0.44 () {56 vars in 1143 bytes} [Wed May 25 11:54:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:54:39.684534 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f51429-a3c8-475a-b2da-4ed7a28670f4 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:39.794655 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f51429-a3c8-475a-b2da-4ed7a28670f4 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:39.832252 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6183e8b-c4e8-4e87-9aea-ce79828b7030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:39.833501 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6183e8b-c4e8-4e87-9aea-ce79828b7030 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:39.833787 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6183e8b-c4e8-4e87-9aea-ce79828b7030 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:39.834063 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6183e8b-c4e8-4e87-9aea-ce79828b7030 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:39.846466 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6183e8b-c4e8-4e87-9aea-ce79828b7030 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:39.848378 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6183e8b-c4e8-4e87-9aea-ce79828b7030 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:39.868611 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-f6183e8b-c4e8-4e87-9aea-ce79828b7030 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:54:39.868611 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:54:39.868611 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:54:39.868611 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:54:39.868611 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:54:39.868611 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:54:39.868611 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:54:39.868611 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:54:39.868611 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:54:39.868611 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:54:39.868611 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:54:39.868611 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:54:39.868611 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 11:54:39.868611 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 11:54:39.868611 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 11:54:39.869785 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 11:54:39.869785 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:54:39.869785 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:54:39.869785 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:54:39.869785 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:54:39.869785 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:54:39.869785 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:54:39.869785 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:54:39.869785 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:54:39.869785 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:54:39.869785 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:54:39.869785 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:54:39.869785 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:54:39.869785 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:54:39.869785 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:54:39.869785 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:54:39.869785 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:54:39.870880 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 11:54:39.870880 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 11:54:39.870880 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:54:39.870880 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:54:39.870880 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 430/849] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:54:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:54:39.876252 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6475536b-3e7c-4ecf-83e6-50704cb03fd7 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:40.003749 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6475536b-3e7c-4ecf-83e6-50704cb03fd7 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:40.006638 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:54:40.045801 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1813a037-3499-4895-a33e-303155631561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:40.046593 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1813a037-3499-4895-a33e-303155631561 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:40.046911 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1813a037-3499-4895-a33e-303155631561 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:40.047291 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1813a037-3499-4895-a33e-303155631561 None admin] PATH_INFO: `/v3/domains` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:40.048068 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1813a037-3499-4895-a33e-303155631561 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:54:40.048470 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1813a037-3499-4895-a33e-303155631561 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:40.050000 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1813a037-3499-4895-a33e-303155631561 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:40.061879 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 420/850] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 25 11:54:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:54:40.068610 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6183e8b-c4e8-4e87-9aea-ce79828b7030 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:40.072919 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:54:40.179935 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6183e8b-c4e8-4e87-9aea-ce79828b7030 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:40.219568 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9fce25-c3a0-4087-b7e7-680a47fba7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:40.219568 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9fce25-c3a0-4087-b7e7-680a47fba7e2 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:40.219568 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9fce25-c3a0-4087-b7e7-680a47fba7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:40.219568 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9fce25-c3a0-4087-b7e7-680a47fba7e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:40.226737 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9fce25-c3a0-4087-b7e7-680a47fba7e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:40.228230 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9fce25-c3a0-4087-b7e7-680a47fba7e2 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:40.243513 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-7c9fce25-c3a0-4087-b7e7-680a47fba7e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 11:54:40.243513 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:54:40.243513 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:54:40.243513 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:54:40.243513 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:54:40.243513 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:54:40.243513 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:54:40.243513 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:54:40.243513 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:54:40.243513 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:54:40.243513 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:54:40.243513 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:54:40.243513 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 11:54:40.243513 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 11:54:40.243513 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 11:54:40.244585 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 11:54:40.244585 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:54:40.244585 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:54:40.244585 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:54:40.244585 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:54:40.244585 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:54:40.244585 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:54:40.244585 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:54:40.244585 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:54:40.244585 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:54:40.244585 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:54:40.244585 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:54:40.244585 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:54:40.244585 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:54:40.244585 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:54:40.244585 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:54:40.244585 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:54:40.245581 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 11:54:40.245581 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 11:54:40.245581 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 11:54:40.245581 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 11:54:40.245581 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 11:54:40.245581 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 11:54:40.245581 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 11:54:40.245581 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:54:40.251923 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 431/851] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 25 11:54:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:54:40.252046 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1813a037-3499-4895-a33e-303155631561 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:40.367935 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1813a037-3499-4895-a33e-303155631561 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:40.407340 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54807657-ba9f-44d0-9c86-20d3dc798352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:40.408138 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54807657-ba9f-44d0-9c86-20d3dc798352 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:40.408447 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54807657-ba9f-44d0-9c86-20d3dc798352 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:40.408732 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54807657-ba9f-44d0-9c86-20d3dc798352 None admin] PATH_INFO: `/v3/projects` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:40.409670 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54807657-ba9f-44d0-9c86-20d3dc798352 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:54:40.410010 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54807657-ba9f-44d0-9c86-20d3dc798352 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:40.412437 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54807657-ba9f-44d0-9c86-20d3dc798352 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:40.429611 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 421/852] 10.222.0.44 () {56 vars in 1148 bytes} [Wed May 25 11:54:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:54:40.436238 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9fce25-c3a0-4087-b7e7-680a47fba7e2 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:40.505292 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:54:40.546106 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9fce25-c3a0-4087-b7e7-680a47fba7e2 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:40.583653 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eacf161-4651-4336-aa18-3031c2a65783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:40.584573 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eacf161-4651-4336-aa18-3031c2a65783 None admin] REQUEST_METHOD: `PUT` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:40.584859 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eacf161-4651-4336-aa18-3031c2a65783 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:40.585137 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eacf161-4651-4336-aa18-3031c2a65783 None admin] PATH_INFO: `/v3/projects/57e08d47948142978437098a8120be78/users/94f4a0c602a7495dbb36dd768cc55a47/roles/33fd4a41fa554c6699a6c832f8eb793e` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:40.602428 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eacf161-4651-4336-aa18-3031c2a65783 None admin] RBAC: Authorizing `identity:create_grant(project_id=57e08d47948142978437098a8120be78, user_id=94f4a0c602a7495dbb36dd768cc55a47, role_id=33fd4a41fa554c6699a6c832f8eb793e)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:40.604453 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eacf161-4651-4336-aa18-3031c2a65783 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:40.621913 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 432/853] 10.222.0.44 () {58 vars in 1439 bytes} [Wed May 25 11:54:40 2022] PUT /identity/v3/projects/57e08d47948142978437098a8120be78/users/94f4a0c602a7495dbb36dd768cc55a47/roles/33fd4a41fa554c6699a6c832f8eb793e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 11:54:43.054088 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746710cc-5475-42bc-bfcd-d265fe7a4377 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:43.054676 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746710cc-5475-42bc-bfcd-d265fe7a4377 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:43.054676 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746710cc-5475-42bc-bfcd-d265fe7a4377 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:43.056177 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 422/854] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:54:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:54:43.062400 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d603c9-55ca-4142-ac25-20acae4e8ddd None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:43.062866 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d603c9-55ca-4142-ac25-20acae4e8ddd None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:43.063106 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d603c9-55ca-4142-ac25-20acae4e8ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:43.080988 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-83d603c9-55ca-4142-ac25-20acae4e8ddd None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:54:43.082197 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-83d603c9-55ca-4142-ac25-20acae4e8ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:54:43.162230 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 433/855] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:54:43 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 11:54:43.194109 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746710cc-5475-42bc-bfcd-d265fe7a4377 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:43.223976 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:54:43.312995 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746710cc-5475-42bc-bfcd-d265fe7a4377 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:43.351290 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff0d3eb-c574-4159-83aa-d7729f2f43fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:43.352269 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0d3eb-c574-4159-83aa-d7729f2f43fe None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:43.352512 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0d3eb-c574-4159-83aa-d7729f2f43fe None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:43.352787 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0d3eb-c574-4159-83aa-d7729f2f43fe None admin] PATH_INFO: `/v3/roles/service` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:43.363654 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff0d3eb-c574-4159-83aa-d7729f2f43fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:54:43.372257 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-bff0d3eb-c574-4159-83aa-d7729f2f43fe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 11:54:43.372257 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:54:43.372257 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:54:43.372257 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:54:43.372257 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:54:43.372257 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:54:43.372257 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:54:43.372257 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:54:43.372257 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:54:43.372257 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:54:43.372257 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:54:43.372257 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:54:43.372257 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:54:43.372257 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:54:43.372257 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:54:43.372257 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:54:43.373324 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:54:43.373324 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:54:43.373324 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:54:43.373324 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:54:43.373324 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:54:43.373324 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:54:43.373324 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:54:43.373324 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:54:43.373324 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:54:43.373324 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:54:43.373324 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:54:43.373324 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:54:43.373324 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:54:43.373324 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:54:43.373324 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:54:43.373324 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:54:43.379092 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:54:43.379092 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:54:43.379092 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:54:43.379092 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:54:43.379092 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:54:43.379092 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:54:43.379092 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:54:43.379092 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:54:43.379092 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:54:43.379092 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:54:43.379092 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 11:54:43.379092 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:54:43.379092 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 423/856] 10.222.0.44 () {56 vars in 1102 bytes} [Wed May 25 11:54:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:54:43.381283 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d603c9-55ca-4142-ac25-20acae4e8ddd None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:43.428832 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:54:43.493208 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d603c9-55ca-4142-ac25-20acae4e8ddd None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:43.529385 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92961e0c-3238-4f4d-bfd8-23e422d0a72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:43.530082 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92961e0c-3238-4f4d-bfd8-23e422d0a72c None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:43.530365 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92961e0c-3238-4f4d-bfd8-23e422d0a72c None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:43.530630 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92961e0c-3238-4f4d-bfd8-23e422d0a72c None admin] PATH_INFO: `/v3/roles` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:43.531381 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92961e0c-3238-4f4d-bfd8-23e422d0a72c None admin] RBAC: Adding query filter params (name=service) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:54:43.531687 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92961e0c-3238-4f4d-bfd8-23e422d0a72c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:43.533144 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92961e0c-3238-4f4d-bfd8-23e422d0a72c None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:43.541840 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 434/857] 10.222.0.44 () {56 vars in 1103 bytes} [Wed May 25 11:54:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:54:43.547446 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff0d3eb-c574-4159-83aa-d7729f2f43fe None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:43.657704 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:54:43.674605 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff0d3eb-c574-4159-83aa-d7729f2f43fe None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:43.710531 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f967f-bfcd-499a-983b-56b79c916071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:43.711324 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f967f-bfcd-499a-983b-56b79c916071 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:43.711613 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f967f-bfcd-499a-983b-56b79c916071 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:43.711908 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f967f-bfcd-499a-983b-56b79c916071 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:43.722752 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680f967f-bfcd-499a-983b-56b79c916071 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:43.724209 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680f967f-bfcd-499a-983b-56b79c916071 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:43.742052 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-680f967f-bfcd-499a-983b-56b79c916071 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:54:43.742052 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:54:43.742052 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:54:43.742052 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:54:43.742052 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:54:43.742052 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:54:43.742052 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:54:43.742052 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:54:43.742052 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:54:43.742052 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:54:43.742052 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:54:43.742052 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:54:43.742052 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 11:54:43.742052 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 11:54:43.742052 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 11:54:43.743170 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 11:54:43.743170 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:54:43.743170 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:54:43.743170 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:54:43.743170 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:54:43.743170 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:54:43.743170 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:54:43.743170 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:54:43.743170 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:54:43.743170 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:54:43.743170 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:54:43.743170 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:54:43.743170 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:54:43.743170 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:54:43.743170 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:54:43.743170 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:54:43.743170 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:54:43.744411 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 11:54:43.744411 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 11:54:43.744411 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:54:43.744411 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:54:43.744411 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 424/858] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:54:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:54:43.749231 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92961e0c-3238-4f4d-bfd8-23e422d0a72c None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:43.856068 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92961e0c-3238-4f4d-bfd8-23e422d0a72c None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:43.858404 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:54:43.895872 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2184a08-8901-411f-b9a0-a8910252ec2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:43.896599 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2184a08-8901-411f-b9a0-a8910252ec2a None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:43.896919 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2184a08-8901-411f-b9a0-a8910252ec2a None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:43.897315 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2184a08-8901-411f-b9a0-a8910252ec2a None admin] PATH_INFO: `/v3/domains` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:43.898164 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2184a08-8901-411f-b9a0-a8910252ec2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:54:43.898445 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2184a08-8901-411f-b9a0-a8910252ec2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:43.900185 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2184a08-8901-411f-b9a0-a8910252ec2a None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:43.915337 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 435/859] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 25 11:54:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:54:43.922080 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f967f-bfcd-499a-983b-56b79c916071 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:44.044480 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f967f-bfcd-499a-983b-56b79c916071 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:44.078712 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c58a7-b48f-4cac-b340-422699501be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:44.079515 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c58a7-b48f-4cac-b340-422699501be0 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:44.079817 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c58a7-b48f-4cac-b340-422699501be0 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:44.080097 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c58a7-b48f-4cac-b340-422699501be0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:44.082808 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:54:44.088697 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5c58a7-b48f-4cac-b340-422699501be0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:44.090273 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5c58a7-b48f-4cac-b340-422699501be0 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:44.106731 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-0f5c58a7-b48f-4cac-b340-422699501be0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 11:54:44.106731 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:54:44.106731 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:54:44.106731 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:54:44.106731 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:54:44.106731 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:54:44.106731 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:54:44.106731 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:54:44.106731 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:54:44.106731 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:54:44.106731 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:54:44.106731 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:54:44.106731 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 11:54:44.106731 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 11:54:44.106731 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 11:54:44.106731 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 11:54:44.107835 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:54:44.107835 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:54:44.107835 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 11:54:44.107835 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 11:54:44.107835 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 11:54:44.107835 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 11:54:44.107835 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:54:44.107835 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:54:44.107835 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:54:44.107835 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:54:44.107835 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:54:44.107835 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:54:44.107835 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:54:44.107835 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:54:44.107835 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:54:44.107835 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:54:44.107835 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:54:44.107835 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:54:44.108840 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:54:44.108840 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:54:44.108840 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 11:54:44.108840 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 11:54:44.108840 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 11:54:44.108840 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 11:54:44.108840 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 11:54:44.108840 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 11:54:44.108840 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 11:54:44.108840 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:54:44.108840 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 425/860] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:54:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:54:44.114426 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2184a08-8901-411f-b9a0-a8910252ec2a None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:44.232692 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2184a08-8901-411f-b9a0-a8910252ec2a None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:44.271230 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a93561-a0a5-4549-9cd8-3398e66c06f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:44.271974 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a93561-a0a5-4549-9cd8-3398e66c06f4 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:44.272272 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a93561-a0a5-4549-9cd8-3398e66c06f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:44.272582 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a93561-a0a5-4549-9cd8-3398e66c06f4 None admin] PATH_INFO: `/v3/users` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:44.273544 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a93561-a0a5-4549-9cd8-3398e66c06f4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:54:44.273861 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a93561-a0a5-4549-9cd8-3398e66c06f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:44.275462 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a93561-a0a5-4549-9cd8-3398e66c06f4 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:44.293709 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 436/861] 10.222.0.44 () {56 vars in 1143 bytes} [Wed May 25 11:54:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:54:44.300181 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c58a7-b48f-4cac-b340-422699501be0 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:44.409861 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c58a7-b48f-4cac-b340-422699501be0 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:44.445488 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f647e956-c385-45ab-bf4d-bad16c969853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:44.446068 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647e956-c385-45ab-bf4d-bad16c969853 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:44.446349 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647e956-c385-45ab-bf4d-bad16c969853 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:44.446625 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f647e956-c385-45ab-bf4d-bad16c969853 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:44.526612 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:54:44.535274 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f647e956-c385-45ab-bf4d-bad16c969853 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:44.536817 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f647e956-c385-45ab-bf4d-bad16c969853 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:44.650395 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 426/862] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 25 11:54:44 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 11:54:44.656324 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a93561-a0a5-4549-9cd8-3398e66c06f4 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:44.681695 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:54:44.765682 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a93561-a0a5-4549-9cd8-3398e66c06f4 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:44.800804 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4367e20b-c1f7-42f6-a2c0-982d911b904d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:44.801683 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367e20b-c1f7-42f6-a2c0-982d911b904d None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:44.801985 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367e20b-c1f7-42f6-a2c0-982d911b904d None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:44.802261 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367e20b-c1f7-42f6-a2c0-982d911b904d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:44.812730 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4367e20b-c1f7-42f6-a2c0-982d911b904d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:44.814546 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4367e20b-c1f7-42f6-a2c0-982d911b904d None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:44.834182 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-4367e20b-c1f7-42f6-a2c0-982d911b904d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:54:44.834182 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:54:44.834182 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:54:44.834182 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:54:44.834182 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:54:44.834182 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:54:44.834182 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:54:44.834182 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:54:44.834182 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:54:44.834182 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:54:44.834182 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:54:44.834182 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:54:44.834182 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 11:54:44.834182 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 11:54:44.834182 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 11:54:44.835305 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 11:54:44.835305 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:54:44.835305 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:54:44.835305 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:54:44.835305 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:54:44.835305 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:54:44.835305 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:54:44.835305 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:54:44.835305 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:54:44.835305 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:54:44.835305 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:54:44.835305 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:54:44.835305 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:54:44.835305 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:54:44.835305 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:54:44.835305 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:54:44.835305 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:54:44.836276 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 11:54:44.836276 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 11:54:44.836276 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:54:44.836276 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:54:44.836276 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 437/863] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:54:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:54:44.841202 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f647e956-c385-45ab-bf4d-bad16c969853 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:44.955943 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:54:44.963573 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f647e956-c385-45ab-bf4d-bad16c969853 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:45.014469 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc2f93-f3c6-4386-a88c-a2c620858f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:45.015206 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc2f93-f3c6-4386-a88c-a2c620858f2f None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:45.015466 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc2f93-f3c6-4386-a88c-a2c620858f2f None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:45.015878 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc2f93-f3c6-4386-a88c-a2c620858f2f None admin] PATH_INFO: `/v3/domains` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:45.016523 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bc2f93-f3c6-4386-a88c-a2c620858f2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:54:45.016870 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bc2f93-f3c6-4386-a88c-a2c620858f2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:45.018486 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bc2f93-f3c6-4386-a88c-a2c620858f2f None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:45.032244 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 427/864] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 25 11:54:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:54:45.037767 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4367e20b-c1f7-42f6-a2c0-982d911b904d None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:45.121003 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:54:45.149293 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4367e20b-c1f7-42f6-a2c0-982d911b904d None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:45.191771 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13728d96-bd5b-4fbd-97c3-e369265ee29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:45.192623 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13728d96-bd5b-4fbd-97c3-e369265ee29e None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:45.192871 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13728d96-bd5b-4fbd-97c3-e369265ee29e None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:45.193148 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13728d96-bd5b-4fbd-97c3-e369265ee29e None admin] PATH_INFO: `/v3/projects/service` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:45.200128 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13728d96-bd5b-4fbd-97c3-e369265ee29e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:45.201835 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13728d96-bd5b-4fbd-97c3-e369265ee29e None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:45.218911 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-13728d96-bd5b-4fbd-97c3-e369265ee29e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 11:54:45.218911 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:54:45.218911 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:54:45.218911 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:54:45.218911 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:54:45.218911 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:54:45.218911 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:54:45.218911 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:54:45.218911 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:54:45.218911 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:54:45.218911 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:54:45.218911 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:54:45.218911 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 11:54:45.218911 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 11:54:45.218911 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 11:54:45.220106 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 11:54:45.220106 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:54:45.220106 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:54:45.220106 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:54:45.220106 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:54:45.220106 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:54:45.220106 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:54:45.220106 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:54:45.220106 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:54:45.220106 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:54:45.220106 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:54:45.220106 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:54:45.220106 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:54:45.220106 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:54:45.220106 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:54:45.220106 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:54:45.220106 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:54:45.221281 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 11:54:45.221281 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 11:54:45.221281 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 11:54:45.221281 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 11:54:45.221281 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 11:54:45.221281 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 11:54:45.221281 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 11:54:45.221281 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:54:45.221281 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 438/865] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 25 11:54:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:54:45.226750 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc2f93-f3c6-4386-a88c-a2c620858f2f None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:45.339660 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc2f93-f3c6-4386-a88c-a2c620858f2f None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:45.376996 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ac4e54-4938-4ad4-a4b5-f11ee32c5221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:45.377751 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac4e54-4938-4ad4-a4b5-f11ee32c5221 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:45.378106 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac4e54-4938-4ad4-a4b5-f11ee32c5221 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:45.378391 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac4e54-4938-4ad4-a4b5-f11ee32c5221 None admin] PATH_INFO: `/v3/projects` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:45.379860 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ac4e54-4938-4ad4-a4b5-f11ee32c5221 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:54:45.380263 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ac4e54-4938-4ad4-a4b5-f11ee32c5221 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:45.381844 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ac4e54-4938-4ad4-a4b5-f11ee32c5221 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:45.399355 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 428/866] 10.222.0.44 () {56 vars in 1148 bytes} [Wed May 25 11:54:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 11:54:45.407634 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13728d96-bd5b-4fbd-97c3-e369265ee29e None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:45.524813 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13728d96-bd5b-4fbd-97c3-e369265ee29e None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:45.562208 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25442b3d-2af3-492f-84b7-4dc17e516733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:45.563062 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25442b3d-2af3-492f-84b7-4dc17e516733 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:45.563448 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25442b3d-2af3-492f-84b7-4dc17e516733 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:45.563739 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25442b3d-2af3-492f-84b7-4dc17e516733 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:45.564822 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25442b3d-2af3-492f-84b7-4dc17e516733 None admin] RBAC: Adding query filter params (role.id=33fd4a41fa554c6699a6c832f8eb793e, scope.project.id=57e08d47948142978437098a8120be78, user.id=94f4a0c602a7495dbb36dd768cc55a47) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:54:45.565263 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25442b3d-2af3-492f-84b7-4dc17e516733 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:45.566906 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25442b3d-2af3-492f-84b7-4dc17e516733 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:45.568821 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:54:45.574233 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 439/867] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 25 11:54:45 2022] GET /identity/v3/role_assignments?user.id=94f4a0c602a7495dbb36dd768cc55a47&scope.project.id=57e08d47948142978437098a8120be78&role.id=33fd4a41fa554c6699a6c832f8eb793e => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:54:47.977427 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f1960-e1a3-4eac-b41b-92c1f10bc3dd None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:47.978034 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f1960-e1a3-4eac-b41b-92c1f10bc3dd None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:47.978131 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f1960-e1a3-4eac-b41b-92c1f10bc3dd None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:47.979833 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 429/868] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:54:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:54:47.986317 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c1ade-3316-49ac-a666-547c21edb98b None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:47.986740 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c1ade-3316-49ac-a666-547c21edb98b None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:47.986905 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c1ade-3316-49ac-a666-547c21edb98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:48.005354 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-da7c1ade-3316-49ac-a666-547c21edb98b None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:54:48.006546 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-da7c1ade-3316-49ac-a666-547c21edb98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:54:48.080065 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 440/869] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:54:47 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 11:54:48.109301 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f1960-e1a3-4eac-b41b-92c1f10bc3dd None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:48.130398 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:54:48.223693 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f1960-e1a3-4eac-b41b-92c1f10bc3dd None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:48.259256 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01f6aa5-9510-45e7-9d12-76d1c865c8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:48.260082 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f6aa5-9510-45e7-9d12-76d1c865c8e8 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:48.260367 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f6aa5-9510-45e7-9d12-76d1c865c8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:48.260642 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f6aa5-9510-45e7-9d12-76d1c865c8e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:48.272005 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01f6aa5-9510-45e7-9d12-76d1c865c8e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:54:48.279729 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-e01f6aa5-9510-45e7-9d12-76d1c865c8e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 11:54:48.279729 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:54:48.279729 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:54:48.279729 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:54:48.279729 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:54:48.279729 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:54:48.279729 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:54:48.279729 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:54:48.279729 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:54:48.279729 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:54:48.279729 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:54:48.279729 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:54:48.279729 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:54:48.279729 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:54:48.279729 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:54:48.279729 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:54:48.280861 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:54:48.280861 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:54:48.280861 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:54:48.280861 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:54:48.280861 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:54:48.280861 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:54:48.280861 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:54:48.280861 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:54:48.280861 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:54:48.280861 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:54:48.280861 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:54:48.280861 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:54:48.280861 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:54:48.280861 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:54:48.280861 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:54:48.280861 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:54:48.281785 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:54:48.281785 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:54:48.281785 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:54:48.281785 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:54:48.281785 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:54:48.281785 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:54:48.281785 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:54:48.281785 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:54:48.281785 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:54:48.281785 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:54:48.281785 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 11:54:48.281785 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:54:48.281785 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 430/870] 10.222.0.44 () {56 vars in 1096 bytes} [Wed May 25 11:54:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:54:48.287389 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c1ade-3316-49ac-a666-547c21edb98b None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:48.401642 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c1ade-3316-49ac-a666-547c21edb98b None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:48.430195 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:54:48.438840 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeab7f1-5840-4db1-913a-1c8df76817ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:48.439565 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeab7f1-5840-4db1-913a-1c8df76817ec None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:48.439883 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeab7f1-5840-4db1-913a-1c8df76817ec None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:48.440160 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeab7f1-5840-4db1-913a-1c8df76817ec None admin] PATH_INFO: `/v3/roles` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:48.440893 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeab7f1-5840-4db1-913a-1c8df76817ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:54:48.441203 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeab7f1-5840-4db1-913a-1c8df76817ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:48.442613 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeab7f1-5840-4db1-913a-1c8df76817ec None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:48.451237 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 441/871] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 25 11:54:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:54:48.458039 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01f6aa5-9510-45e7-9d12-76d1c865c8e8 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:48.551903 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:54:48.576989 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01f6aa5-9510-45e7-9d12-76d1c865c8e8 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:48.616132 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b02ef-6c16-4a9d-9b49-f173b82fd1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:48.617106 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b02ef-6c16-4a9d-9b49-f173b82fd1c7 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:48.617470 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b02ef-6c16-4a9d-9b49-f173b82fd1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:48.617717 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b02ef-6c16-4a9d-9b49-f173b82fd1c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:48.629602 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888b02ef-6c16-4a9d-9b49-f173b82fd1c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:48.631191 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888b02ef-6c16-4a9d-9b49-f173b82fd1c7 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:48.651158 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-888b02ef-6c16-4a9d-9b49-f173b82fd1c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:54:48.651158 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:54:48.651158 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:54:48.651158 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:54:48.651158 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:54:48.651158 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:54:48.651158 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:54:48.651158 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:54:48.651158 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:54:48.651158 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:54:48.651158 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:54:48.651158 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:54:48.651158 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 11:54:48.651158 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 11:54:48.651158 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 11:54:48.652289 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 11:54:48.652289 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:54:48.652289 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:54:48.652289 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:54:48.652289 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:54:48.652289 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:54:48.652289 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:54:48.652289 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:54:48.652289 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:54:48.652289 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:54:48.652289 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:54:48.652289 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:54:48.652289 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:54:48.652289 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:54:48.652289 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:54:48.652289 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:54:48.652289 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:54:48.653182 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 11:54:48.653182 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 11:54:48.653182 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:54:48.653182 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:54:48.653182 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 431/872] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:54:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:54:48.658341 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeab7f1-5840-4db1-913a-1c8df76817ec None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:48.765203 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeab7f1-5840-4db1-913a-1c8df76817ec None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:48.800577 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df7975-231d-4f27-bd36-4fca28e06b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:48.801263 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df7975-231d-4f27-bd36-4fca28e06b99 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:48.801601 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df7975-231d-4f27-bd36-4fca28e06b99 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:48.801817 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df7975-231d-4f27-bd36-4fca28e06b99 None admin] PATH_INFO: `/v3/domains` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:48.802578 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82df7975-231d-4f27-bd36-4fca28e06b99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:54:48.802829 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82df7975-231d-4f27-bd36-4fca28e06b99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:48.804236 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82df7975-231d-4f27-bd36-4fca28e06b99 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:48.816327 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 442/873] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 25 11:54:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:54:48.821990 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b02ef-6c16-4a9d-9b49-f173b82fd1c7 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:48.943226 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b02ef-6c16-4a9d-9b49-f173b82fd1c7 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:48.972590 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:54:48.982169 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1167c8-a0dc-47de-80d9-41419d39ac80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:48.982996 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1167c8-a0dc-47de-80d9-41419d39ac80 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:48.983273 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1167c8-a0dc-47de-80d9-41419d39ac80 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:48.983547 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1167c8-a0dc-47de-80d9-41419d39ac80 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:48.992153 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1167c8-a0dc-47de-80d9-41419d39ac80 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:48.993629 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1167c8-a0dc-47de-80d9-41419d39ac80 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:49.009276 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-3e1167c8-a0dc-47de-80d9-41419d39ac80 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 11:54:49.009276 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:54:49.009276 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:54:49.009276 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:54:49.009276 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:54:49.009276 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:54:49.009276 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:54:49.009276 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:54:49.009276 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:54:49.009276 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:54:49.009276 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:54:49.009276 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:54:49.009276 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 11:54:49.009276 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 11:54:49.009276 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 11:54:49.009276 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 11:54:49.010326 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:54:49.010326 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:54:49.010326 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 11:54:49.010326 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 11:54:49.010326 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 11:54:49.010326 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 11:54:49.010326 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:54:49.010326 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:54:49.010326 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:54:49.010326 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:54:49.010326 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:54:49.010326 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:54:49.010326 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:54:49.010326 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:54:49.010326 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:54:49.010326 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:54:49.010326 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:54:49.010326 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:54:49.011712 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:54:49.011712 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:54:49.011712 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 11:54:49.011712 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 11:54:49.011712 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 11:54:49.011712 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 11:54:49.011712 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 11:54:49.011712 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 11:54:49.011712 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 11:54:49.011712 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:54:49.011712 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 432/874] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:54:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:54:49.016563 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df7975-231d-4f27-bd36-4fca28e06b99 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:49.069750 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:54:49.121449 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df7975-231d-4f27-bd36-4fca28e06b99 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:49.157695 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7eb87d-8663-44f5-9cb9-41d3ab0394c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:49.158376 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7eb87d-8663-44f5-9cb9-41d3ab0394c3 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:49.158661 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7eb87d-8663-44f5-9cb9-41d3ab0394c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:49.158939 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7eb87d-8663-44f5-9cb9-41d3ab0394c3 None admin] PATH_INFO: `/v3/users` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:49.159815 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7eb87d-8663-44f5-9cb9-41d3ab0394c3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:54:49.160129 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7eb87d-8663-44f5-9cb9-41d3ab0394c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:49.161614 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7eb87d-8663-44f5-9cb9-41d3ab0394c3 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:49.181239 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 443/875] 10.222.0.44 () {56 vars in 1143 bytes} [Wed May 25 11:54:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:54:49.186845 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1167c8-a0dc-47de-80d9-41419d39ac80 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:49.291737 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1167c8-a0dc-47de-80d9-41419d39ac80 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:49.324592 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1735736e-0257-4b70-8de2-8b793f4e3ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:49.325173 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1735736e-0257-4b70-8de2-8b793f4e3ffa None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:49.325459 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1735736e-0257-4b70-8de2-8b793f4e3ffa None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:49.325744 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1735736e-0257-4b70-8de2-8b793f4e3ffa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:49.381067 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:54:49.398134 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1735736e-0257-4b70-8de2-8b793f4e3ffa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:49.399616 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1735736e-0257-4b70-8de2-8b793f4e3ffa None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:49.498217 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 433/876] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 25 11:54:49 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 11:54:49.504649 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7eb87d-8663-44f5-9cb9-41d3ab0394c3 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:49.601380 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7eb87d-8663-44f5-9cb9-41d3ab0394c3 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:49.610146 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:54:49.634910 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f02622-748f-4a3b-9ed6-c2b490de838b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:49.635695 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f02622-748f-4a3b-9ed6-c2b490de838b None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:49.636014 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f02622-748f-4a3b-9ed6-c2b490de838b None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:49.636296 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f02622-748f-4a3b-9ed6-c2b490de838b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:49.646194 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f02622-748f-4a3b-9ed6-c2b490de838b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:49.647626 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f02622-748f-4a3b-9ed6-c2b490de838b None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:49.664544 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-49f02622-748f-4a3b-9ed6-c2b490de838b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:54:49.664544 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:54:49.664544 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:54:49.664544 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:54:49.664544 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:54:49.664544 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:54:49.664544 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:54:49.664544 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:54:49.664544 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:54:49.664544 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:54:49.664544 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:54:49.664544 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:54:49.664544 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 11:54:49.664544 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 11:54:49.664544 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 11:54:49.665583 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 11:54:49.665583 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:54:49.665583 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:54:49.665583 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:54:49.665583 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:54:49.665583 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:54:49.665583 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:54:49.665583 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:54:49.665583 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:54:49.665583 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:54:49.665583 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:54:49.665583 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:54:49.665583 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:54:49.665583 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:54:49.665583 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:54:49.665583 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:54:49.665583 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:54:49.666705 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 11:54:49.666705 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 11:54:49.666705 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:54:49.666705 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:54:49.666705 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 444/877] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:54:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:54:49.671323 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1735736e-0257-4b70-8de2-8b793f4e3ffa None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:49.755997 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:54:49.768161 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1735736e-0257-4b70-8de2-8b793f4e3ffa None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:49.800953 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea01a4e2-4405-44bc-b908-a880476fc3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:49.802118 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01a4e2-4405-44bc-b908-a880476fc3a0 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:49.802404 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01a4e2-4405-44bc-b908-a880476fc3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:49.802684 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01a4e2-4405-44bc-b908-a880476fc3a0 None admin] PATH_INFO: `/v3/domains` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:49.803398 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea01a4e2-4405-44bc-b908-a880476fc3a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:54:49.803707 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea01a4e2-4405-44bc-b908-a880476fc3a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:49.805104 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea01a4e2-4405-44bc-b908-a880476fc3a0 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:49.815805 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 434/878] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 25 11:54:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:54:49.821315 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f02622-748f-4a3b-9ed6-c2b490de838b None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:49.922635 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f02622-748f-4a3b-9ed6-c2b490de838b None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:49.961058 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b01c63-fe01-4828-8c04-66c65f18e7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:49.961840 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b01c63-fe01-4828-8c04-66c65f18e7ad None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:49.962122 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b01c63-fe01-4828-8c04-66c65f18e7ad None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:49.962396 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b01c63-fe01-4828-8c04-66c65f18e7ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:49.968815 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b01c63-fe01-4828-8c04-66c65f18e7ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:49.970256 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b01c63-fe01-4828-8c04-66c65f18e7ad None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:49.984040 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-90b01c63-fe01-4828-8c04-66c65f18e7ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 11:54:49.984040 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:54:49.984040 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:54:49.984040 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:54:49.984040 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:54:49.984040 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:54:49.984040 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:54:49.984040 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:54:49.984040 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:54:49.984040 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:54:49.984040 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:54:49.984040 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:54:49.984040 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 11:54:49.984040 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 11:54:49.984040 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 11:54:49.984938 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 11:54:49.984938 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:54:49.984938 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:54:49.984938 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:54:49.984938 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:54:49.984938 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:54:49.984938 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:54:49.984938 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:54:49.984938 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:54:49.984938 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:54:49.984938 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:54:49.984938 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:54:49.984938 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:54:49.984938 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:54:49.984938 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:54:49.984938 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:54:49.984938 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:54:49.985848 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 11:54:49.985848 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 11:54:49.985848 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 11:54:49.985848 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 11:54:49.985848 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 11:54:49.985848 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 11:54:49.985848 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 11:54:49.985848 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:54:49.985848 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 445/879] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 25 11:54:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:54:49.991503 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea01a4e2-4405-44bc-b908-a880476fc3a0 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:50.094350 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea01a4e2-4405-44bc-b908-a880476fc3a0 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:50.127058 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6949ef8-486e-48fa-9b39-1e6ee5f76f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:50.127711 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6949ef8-486e-48fa-9b39-1e6ee5f76f3f None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:50.128034 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6949ef8-486e-48fa-9b39-1e6ee5f76f3f None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:50.128317 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6949ef8-486e-48fa-9b39-1e6ee5f76f3f None admin] PATH_INFO: `/v3/projects` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:50.129094 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6949ef8-486e-48fa-9b39-1e6ee5f76f3f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:54:50.129408 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6949ef8-486e-48fa-9b39-1e6ee5f76f3f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:50.130838 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6949ef8-486e-48fa-9b39-1e6ee5f76f3f None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:50.142590 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 435/880] 10.222.0.44 () {56 vars in 1148 bytes} [Wed May 25 11:54:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:54:50.148595 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b01c63-fe01-4828-8c04-66c65f18e7ad None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:50.170826 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:54:50.246642 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b01c63-fe01-4828-8c04-66c65f18e7ad None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:50.278853 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3862b93c-74b9-4763-8f05-3d05c66d9cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:50.279496 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862b93c-74b9-4763-8f05-3d05c66d9cbc None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:50.279783 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862b93c-74b9-4763-8f05-3d05c66d9cbc None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:50.280094 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862b93c-74b9-4763-8f05-3d05c66d9cbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:50.280911 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3862b93c-74b9-4763-8f05-3d05c66d9cbc None admin] RBAC: Adding query filter params (role.id=2fe5c1214bcc4c1bafa5a4545161518d, scope.project.id=57e08d47948142978437098a8120be78, user.id=94f4a0c602a7495dbb36dd768cc55a47) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:54:50.281226 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3862b93c-74b9-4763-8f05-3d05c66d9cbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:50.282640 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3862b93c-74b9-4763-8f05-3d05c66d9cbc None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:50.288476 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 446/881] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 25 11:54:50 2022] GET /identity/v3/role_assignments?user.id=94f4a0c602a7495dbb36dd768cc55a47&scope.project.id=57e08d47948142978437098a8120be78&role.id=2fe5c1214bcc4c1bafa5a4545161518d => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:54:52.476583 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6bb806-91bc-4aa0-b980-e936e3481e4e None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:52.477101 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6bb806-91bc-4aa0-b980-e936e3481e4e None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:52.477101 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6bb806-91bc-4aa0-b980-e936e3481e4e None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:52.478421 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 436/882] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:54:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:54:52.483409 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a549b-38e5-4e8e-9fa8-3ac50edead0d None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:52.483810 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a549b-38e5-4e8e-9fa8-3ac50edead0d None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:52.483996 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a549b-38e5-4e8e-9fa8-3ac50edead0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:52.500650 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-554a549b-38e5-4e8e-9fa8-3ac50edead0d None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:54:52.501811 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-554a549b-38e5-4e8e-9fa8-3ac50edead0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:54:52.567527 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 447/883] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:54:52 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 11:54:52.590338 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6bb806-91bc-4aa0-b980-e936e3481e4e None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:52.603445 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:54:52.692468 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6bb806-91bc-4aa0-b980-e936e3481e4e None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:52.724173 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4135ba8-2f70-4a32-9c58-9dba6f944ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:52.724955 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4135ba8-2f70-4a32-9c58-9dba6f944ef1 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:52.725235 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4135ba8-2f70-4a32-9c58-9dba6f944ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:52.725506 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4135ba8-2f70-4a32-9c58-9dba6f944ef1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:52.735275 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4135ba8-2f70-4a32-9c58-9dba6f944ef1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:54:52.743543 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-e4135ba8-2f70-4a32-9c58-9dba6f944ef1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 11:54:52.743543 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:54:52.743543 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:54:52.743543 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:54:52.743543 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:54:52.743543 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:54:52.743543 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:54:52.743543 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:54:52.743543 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:54:52.743543 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:54:52.743543 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:54:52.743543 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:54:52.743543 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:54:52.743543 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:54:52.743543 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:54:52.743543 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:54:52.744693 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:54:52.744693 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:54:52.744693 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:54:52.744693 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:54:52.744693 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:54:52.744693 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:54:52.744693 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:54:52.744693 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:54:52.744693 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:54:52.744693 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:54:52.744693 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:54:52.744693 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:54:52.744693 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:54:52.744693 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:54:52.744693 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:54:52.744693 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:54:52.745684 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:54:52.745684 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:54:52.745684 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:54:52.745684 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:54:52.745684 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:54:52.745684 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:54:52.745684 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:54:52.745684 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:54:52.745684 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:54:52.745684 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:54:52.745684 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 11:54:52.745684 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:54:52.745684 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 437/884] 10.222.0.44 () {56 vars in 1096 bytes} [Wed May 25 11:54:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:54:52.750656 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a549b-38e5-4e8e-9fa8-3ac50edead0d None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:52.765734 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:54:52.846315 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a549b-38e5-4e8e-9fa8-3ac50edead0d None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:52.883864 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b3410-061a-41a3-b2c9-028514ef90b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:52.884965 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b3410-061a-41a3-b2c9-028514ef90b3 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:52.885262 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b3410-061a-41a3-b2c9-028514ef90b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:52.885627 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b3410-061a-41a3-b2c9-028514ef90b3 None admin] PATH_INFO: `/v3/roles` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:52.886683 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64b3410-061a-41a3-b2c9-028514ef90b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:54:52.887041 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64b3410-061a-41a3-b2c9-028514ef90b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:52.889017 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64b3410-061a-41a3-b2c9-028514ef90b3 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:52.898499 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 448/885] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 25 11:54:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:54:52.908257 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4135ba8-2f70-4a32-9c58-9dba6f944ef1 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:52.983387 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:54:53.016489 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4135ba8-2f70-4a32-9c58-9dba6f944ef1 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:53.048818 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af91680-c9b1-4a2a-9829-84b3629aa839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:53.049606 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af91680-c9b1-4a2a-9829-84b3629aa839 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:53.049887 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af91680-c9b1-4a2a-9829-84b3629aa839 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:53.050159 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af91680-c9b1-4a2a-9829-84b3629aa839 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:53.060856 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af91680-c9b1-4a2a-9829-84b3629aa839 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:53.062290 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af91680-c9b1-4a2a-9829-84b3629aa839 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:53.079218 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-9af91680-c9b1-4a2a-9829-84b3629aa839 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:54:53.079218 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:54:53.079218 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:54:53.079218 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:54:53.079218 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:54:53.079218 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:54:53.079218 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:54:53.079218 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:54:53.079218 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:54:53.079218 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:54:53.079218 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:54:53.079218 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:54:53.079218 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 11:54:53.079218 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 11:54:53.079218 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 11:54:53.080142 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 11:54:53.080142 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:54:53.080142 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:54:53.080142 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:54:53.080142 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:54:53.080142 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:54:53.080142 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:54:53.080142 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:54:53.080142 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:54:53.080142 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:54:53.080142 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:54:53.080142 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:54:53.080142 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:54:53.080142 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:54:53.080142 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:54:53.080142 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:54:53.080142 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:54:53.081180 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 11:54:53.081180 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 11:54:53.081180 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:54:53.081180 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:54:53.081180 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 438/886] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:54:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:54:53.086234 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b3410-061a-41a3-b2c9-028514ef90b3 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:53.161076 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:54:53.184151 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b3410-061a-41a3-b2c9-028514ef90b3 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:53.216794 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4321f07-a5c9-43d5-9aee-6bd4d96f4000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:53.217447 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4321f07-a5c9-43d5-9aee-6bd4d96f4000 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:53.217733 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4321f07-a5c9-43d5-9aee-6bd4d96f4000 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:53.218011 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4321f07-a5c9-43d5-9aee-6bd4d96f4000 None admin] PATH_INFO: `/v3/domains` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:53.218721 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4321f07-a5c9-43d5-9aee-6bd4d96f4000 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:54:53.219030 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4321f07-a5c9-43d5-9aee-6bd4d96f4000 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:53.220436 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4321f07-a5c9-43d5-9aee-6bd4d96f4000 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:53.232338 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 449/887] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 25 11:54:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:54:53.237972 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af91680-c9b1-4a2a-9829-84b3629aa839 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:53.334230 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af91680-c9b1-4a2a-9829-84b3629aa839 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:53.353239 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:54:53.366709 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb2b28c-a542-4e2c-8111-1db74a1a102e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:53.367496 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb2b28c-a542-4e2c-8111-1db74a1a102e None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:53.367780 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb2b28c-a542-4e2c-8111-1db74a1a102e None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:53.368083 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb2b28c-a542-4e2c-8111-1db74a1a102e None admin] PATH_INFO: `/v3/users/placement` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:53.375173 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb2b28c-a542-4e2c-8111-1db74a1a102e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:53.376636 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb2b28c-a542-4e2c-8111-1db74a1a102e None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:53.390526 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-abb2b28c-a542-4e2c-8111-1db74a1a102e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 11:54:53.390526 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:54:53.390526 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:54:53.390526 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:54:53.390526 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:54:53.390526 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:54:53.390526 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:54:53.390526 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:54:53.390526 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:54:53.390526 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:54:53.390526 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:54:53.390526 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:54:53.390526 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 11:54:53.390526 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 11:54:53.390526 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 11:54:53.390526 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 11:54:53.391599 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:54:53.391599 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:54:53.391599 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 11:54:53.391599 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 11:54:53.391599 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 11:54:53.391599 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 11:54:53.391599 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:54:53.391599 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:54:53.391599 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:54:53.391599 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:54:53.391599 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:54:53.391599 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:54:53.391599 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:54:53.391599 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:54:53.391599 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:54:53.391599 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:54:53.391599 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:54:53.391599 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:54:53.393169 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:54:53.393169 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:54:53.393169 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 11:54:53.393169 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 11:54:53.393169 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 11:54:53.393169 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 11:54:53.393169 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 11:54:53.393169 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 11:54:53.393169 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 11:54:53.393169 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:54:53.393169 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 439/888] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:54:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:54:53.398098 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4321f07-a5c9-43d5-9aee-6bd4d96f4000 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:53.491669 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4321f07-a5c9-43d5-9aee-6bd4d96f4000 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:53.524266 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d54253-878a-4582-a12d-87eb5f25b3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:53.524921 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d54253-878a-4582-a12d-87eb5f25b3ca None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:53.525205 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d54253-878a-4582-a12d-87eb5f25b3ca None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:53.525482 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d54253-878a-4582-a12d-87eb5f25b3ca None admin] PATH_INFO: `/v3/users` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:53.526302 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d54253-878a-4582-a12d-87eb5f25b3ca None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:54:53.526610 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d54253-878a-4582-a12d-87eb5f25b3ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:53.528074 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d54253-878a-4582-a12d-87eb5f25b3ca None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:53.530510 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:54:53.546144 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 450/889] 10.222.0.44 () {56 vars in 1143 bytes} [Wed May 25 11:54:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:54:53.551624 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb2b28c-a542-4e2c-8111-1db74a1a102e None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:53.647472 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb2b28c-a542-4e2c-8111-1db74a1a102e None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:53.678659 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b7ead-666a-4377-a689-4f9f1e6f9c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:53.679439 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b7ead-666a-4377-a689-4f9f1e6f9c5e None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:53.679723 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b7ead-666a-4377-a689-4f9f1e6f9c5e None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:53.680027 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b7ead-666a-4377-a689-4f9f1e6f9c5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:53.690026 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45b7ead-666a-4377-a689-4f9f1e6f9c5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:53.692047 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45b7ead-666a-4377-a689-4f9f1e6f9c5e None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:53.709056 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-b45b7ead-666a-4377-a689-4f9f1e6f9c5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:54:53.709056 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:54:53.709056 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:54:53.709056 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:54:53.709056 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:54:53.709056 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:54:53.709056 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:54:53.709056 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:54:53.709056 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:54:53.709056 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:54:53.709056 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:54:53.709056 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:54:53.709056 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 11:54:53.709056 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 11:54:53.709056 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 11:54:53.710138 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 11:54:53.710138 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:54:53.710138 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:54:53.710138 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:54:53.710138 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:54:53.710138 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:54:53.710138 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:54:53.710138 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:54:53.710138 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:54:53.710138 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:54:53.710138 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:54:53.710138 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:54:53.710138 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:54:53.710138 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:54:53.710138 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:54:53.710138 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:54:53.710138 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:54:53.711227 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 11:54:53.711227 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 11:54:53.711227 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:54:53.711227 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:54:53.711227 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 440/890] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:54:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:54:53.715744 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d54253-878a-4582-a12d-87eb5f25b3ca None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:53.811514 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d54253-878a-4582-a12d-87eb5f25b3ca None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:53.844374 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cbde78-8867-481c-9d0f-d8cca1558322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:53.845039 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cbde78-8867-481c-9d0f-d8cca1558322 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:53.845308 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cbde78-8867-481c-9d0f-d8cca1558322 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:53.845588 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cbde78-8867-481c-9d0f-d8cca1558322 None admin] PATH_INFO: `/v3/domains` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:53.846304 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cbde78-8867-481c-9d0f-d8cca1558322 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:54:53.846613 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cbde78-8867-481c-9d0f-d8cca1558322 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:53.848035 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cbde78-8867-481c-9d0f-d8cca1558322 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:53.858877 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 451/891] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 25 11:54:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:54:53.865177 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b7ead-666a-4377-a689-4f9f1e6f9c5e None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:53.903015 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:54:53.970934 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b7ead-666a-4377-a689-4f9f1e6f9c5e None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:54.002938 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa739950-2dae-4dd5-b812-f4d44090465d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:54.003725 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa739950-2dae-4dd5-b812-f4d44090465d None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:54.004626 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa739950-2dae-4dd5-b812-f4d44090465d None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:54.004905 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa739950-2dae-4dd5-b812-f4d44090465d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:54.011339 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa739950-2dae-4dd5-b812-f4d44090465d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:54.012818 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa739950-2dae-4dd5-b812-f4d44090465d None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:54.027048 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-fa739950-2dae-4dd5-b812-f4d44090465d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 11:54:54.027048 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:54:54.027048 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:54:54.027048 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:54:54.027048 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:54:54.027048 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:54:54.027048 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:54:54.027048 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:54:54.027048 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:54:54.027048 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:54:54.027048 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:54:54.027048 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:54:54.027048 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 11:54:54.027048 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 11:54:54.027048 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 11:54:54.028131 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 11:54:54.028131 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:54:54.028131 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:54:54.028131 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:54:54.028131 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:54:54.028131 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:54:54.028131 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:54:54.028131 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:54:54.028131 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:54:54.028131 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:54:54.028131 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:54:54.028131 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:54:54.028131 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:54:54.028131 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:54:54.028131 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:54:54.028131 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:54:54.028131 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:54:54.033819 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 11:54:54.033819 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 11:54:54.033819 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 11:54:54.033819 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 11:54:54.033819 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 11:54:54.033819 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 11:54:54.033819 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 11:54:54.033819 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:54:54.033819 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 441/892] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 25 11:54:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:54:54.034304 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cbde78-8867-481c-9d0f-d8cca1558322 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:54.087664 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:54:54.130325 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cbde78-8867-481c-9d0f-d8cca1558322 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:54.163026 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fcf42c-3a88-4005-a1a0-39e1666ed8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:54.163614 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fcf42c-3a88-4005-a1a0-39e1666ed8f5 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:54.163934 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fcf42c-3a88-4005-a1a0-39e1666ed8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:54.164212 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fcf42c-3a88-4005-a1a0-39e1666ed8f5 None admin] PATH_INFO: `/v3/projects` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:54.164992 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fcf42c-3a88-4005-a1a0-39e1666ed8f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:54:54.165303 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fcf42c-3a88-4005-a1a0-39e1666ed8f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:54.166732 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fcf42c-3a88-4005-a1a0-39e1666ed8f5 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:54.178582 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 452/893] 10.222.0.44 () {56 vars in 1148 bytes} [Wed May 25 11:54:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:54:54.184444 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa739950-2dae-4dd5-b812-f4d44090465d None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:54.273648 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:54:54.282500 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa739950-2dae-4dd5-b812-f4d44090465d None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:54.314837 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0413467f-7b0a-4ab6-af23-ac50c00fb0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:54.315714 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413467f-7b0a-4ab6-af23-ac50c00fb0d8 None admin] REQUEST_METHOD: `PUT` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:54.316026 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413467f-7b0a-4ab6-af23-ac50c00fb0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:54.316815 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413467f-7b0a-4ab6-af23-ac50c00fb0d8 None admin] PATH_INFO: `/v3/projects/57e08d47948142978437098a8120be78/users/94f4a0c602a7495dbb36dd768cc55a47/roles/2fe5c1214bcc4c1bafa5a4545161518d` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:54.318813 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0413467f-7b0a-4ab6-af23-ac50c00fb0d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=57e08d47948142978437098a8120be78, user_id=94f4a0c602a7495dbb36dd768cc55a47, role_id=2fe5c1214bcc4c1bafa5a4545161518d)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:54.320279 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0413467f-7b0a-4ab6-af23-ac50c00fb0d8 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:54.332784 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 442/894] 10.222.0.44 () {58 vars in 1439 bytes} [Wed May 25 11:54:54 2022] PUT /identity/v3/projects/57e08d47948142978437098a8120be78/users/94f4a0c602a7495dbb36dd768cc55a47/roles/2fe5c1214bcc4c1bafa5a4545161518d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 11:54:56.546192 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84501f-7013-4829-ac7c-89a35eb3812f None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:56.546708 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84501f-7013-4829-ac7c-89a35eb3812f None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:56.546708 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84501f-7013-4829-ac7c-89a35eb3812f None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:56.548027 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 453/895] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:54:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:54:56.553361 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f38b0c-b647-49bf-a6f4-3f3403256d7b None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:56.553772 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f38b0c-b647-49bf-a6f4-3f3403256d7b None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:56.553916 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f38b0c-b647-49bf-a6f4-3f3403256d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:56.570619 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-30f38b0c-b647-49bf-a6f4-3f3403256d7b None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:54:56.571785 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-30f38b0c-b647-49bf-a6f4-3f3403256d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:54:56.635540 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 443/896] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:54:56 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 11:54:56.662162 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e84501f-7013-4829-ac7c-89a35eb3812f None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:56.758073 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e84501f-7013-4829-ac7c-89a35eb3812f None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:56.772342 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:54:56.791519 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2754f67-9523-4df4-bcdb-c15d27289907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:56.792328 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2754f67-9523-4df4-bcdb-c15d27289907 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:56.792605 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2754f67-9523-4df4-bcdb-c15d27289907 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:56.792876 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2754f67-9523-4df4-bcdb-c15d27289907 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:56.802694 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2754f67-9523-4df4-bcdb-c15d27289907 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 11:54:56.810175 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-d2754f67-9523-4df4-bcdb-c15d27289907 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 11:54:56.810175 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:54:56.810175 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:54:56.810175 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:54:56.810175 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:54:56.810175 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:54:56.810175 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:54:56.810175 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:54:56.810175 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:54:56.810175 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:54:56.810175 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:54:56.810175 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:54:56.810175 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 11:54:56.810175 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 11:54:56.810175 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 11:54:56.810175 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 11:54:56.811242 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 11:54:56.811242 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 11:54:56.811242 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 11:54:56.811242 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 11:54:56.811242 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:54:56.811242 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:54:56.811242 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:54:56.811242 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:54:56.811242 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:54:56.811242 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:54:56.811242 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:54:56.811242 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:54:56.811242 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:54:56.811242 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:54:56.811242 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:54:56.811242 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:54:56.812454 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:54:56.812454 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:54:56.812454 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:54:56.812454 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:54:56.812454 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 11:54:56.812454 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 11:54:56.812454 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 11:54:56.812454 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 11:54:56.812454 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 11:54:56.812454 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 11:54:56.812454 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 11:54:56.812454 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:54:56.812454 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 454/897] 10.222.0.44 () {56 vars in 1096 bytes} [Wed May 25 11:54:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:54:56.817709 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f38b0c-b647-49bf-a6f4-3f3403256d7b None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:56.896756 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:54:56.916867 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f38b0c-b647-49bf-a6f4-3f3403256d7b None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:56.953035 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eae135-c89d-477a-9dd8-ff5bdbc5919f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:56.953705 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eae135-c89d-477a-9dd8-ff5bdbc5919f None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:56.953991 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eae135-c89d-477a-9dd8-ff5bdbc5919f None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:56.954271 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eae135-c89d-477a-9dd8-ff5bdbc5919f None admin] PATH_INFO: `/v3/roles` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:56.955013 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eae135-c89d-477a-9dd8-ff5bdbc5919f None admin] RBAC: Adding query filter params (name=admin) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:54:56.955323 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eae135-c89d-477a-9dd8-ff5bdbc5919f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:56.956744 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eae135-c89d-477a-9dd8-ff5bdbc5919f None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:56.964655 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 444/898] 10.222.0.44 () {56 vars in 1099 bytes} [Wed May 25 11:54:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:54:56.970427 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2754f67-9523-4df4-bcdb-c15d27289907 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:57.065268 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2754f67-9523-4df4-bcdb-c15d27289907 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:57.096654 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6924eb-32a5-4b86-bdf6-12707977f95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:57.097442 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6924eb-32a5-4b86-bdf6-12707977f95f None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:57.097724 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6924eb-32a5-4b86-bdf6-12707977f95f None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:57.097997 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6924eb-32a5-4b86-bdf6-12707977f95f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:57.107967 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6924eb-32a5-4b86-bdf6-12707977f95f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:57.109404 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6924eb-32a5-4b86-bdf6-12707977f95f None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:57.126156 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-bb6924eb-32a5-4b86-bdf6-12707977f95f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:54:57.126156 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:54:57.126156 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:54:57.126156 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:54:57.126156 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:54:57.126156 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:54:57.126156 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:54:57.126156 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:54:57.126156 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:54:57.126156 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:54:57.126156 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:54:57.126156 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:54:57.126156 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 11:54:57.126156 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 11:54:57.126156 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 11:54:57.127112 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 11:54:57.127112 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:54:57.127112 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:54:57.127112 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:54:57.127112 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:54:57.127112 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:54:57.127112 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:54:57.127112 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:54:57.127112 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:54:57.127112 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:54:57.127112 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:54:57.127112 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:54:57.127112 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:54:57.127112 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:54:57.127112 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:54:57.127112 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:54:57.127112 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:54:57.128036 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 11:54:57.128036 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 11:54:57.128036 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:54:57.128036 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:54:57.128036 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 455/899] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:54:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:54:57.133780 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eae135-c89d-477a-9dd8-ff5bdbc5919f None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:57.228630 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eae135-c89d-477a-9dd8-ff5bdbc5919f None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:57.261356 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c80559c-fab6-4dc7-8e02-0af145fd00df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:57.262015 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80559c-fab6-4dc7-8e02-0af145fd00df None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:57.262300 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80559c-fab6-4dc7-8e02-0af145fd00df None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:57.262577 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80559c-fab6-4dc7-8e02-0af145fd00df None admin] PATH_INFO: `/v3/domains` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:57.263290 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c80559c-fab6-4dc7-8e02-0af145fd00df None admin] RBAC: Adding query filter params (name=Default) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:54:57.263594 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c80559c-fab6-4dc7-8e02-0af145fd00df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:57.264984 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c80559c-fab6-4dc7-8e02-0af145fd00df None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:57.276642 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 445/900] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 25 11:54:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:54:57.282293 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6924eb-32a5-4b86-bdf6-12707977f95f None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:57.310107 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:54:57.380094 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6924eb-32a5-4b86-bdf6-12707977f95f None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:57.412254 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6fc522-f134-4418-99d6-489fb489ff30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:57.413043 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6fc522-f134-4418-99d6-489fb489ff30 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:57.413328 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6fc522-f134-4418-99d6-489fb489ff30 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:57.413604 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6fc522-f134-4418-99d6-489fb489ff30 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:57.420851 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6fc522-f134-4418-99d6-489fb489ff30 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:57.422286 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6fc522-f134-4418-99d6-489fb489ff30 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:57.436559 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-4f6fc522-f134-4418-99d6-489fb489ff30 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 11:54:57.436559 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:54:57.436559 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:54:57.436559 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:54:57.436559 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:54:57.436559 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:54:57.436559 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:54:57.436559 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:54:57.436559 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:54:57.436559 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:54:57.436559 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:54:57.436559 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:54:57.436559 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 11:54:57.436559 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 11:54:57.436559 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 11:54:57.436559 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 11:54:57.437625 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:54:57.437625 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:54:57.437625 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 11:54:57.437625 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 11:54:57.437625 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 11:54:57.437625 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 11:54:57.437625 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:54:57.437625 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:54:57.437625 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:54:57.437625 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:54:57.437625 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:54:57.437625 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:54:57.437625 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:54:57.437625 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:54:57.437625 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:54:57.437625 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:54:57.437625 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:54:57.437625 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:54:57.438928 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:54:57.438928 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:54:57.438928 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 11:54:57.438928 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 11:54:57.438928 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 11:54:57.438928 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 11:54:57.438928 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 11:54:57.438928 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 11:54:57.438928 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 11:54:57.438928 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:54:57.438928 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 456/901] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:54:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 11:54:57.443340 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c80559c-fab6-4dc7-8e02-0af145fd00df None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:57.447007 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:54:57.539601 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c80559c-fab6-4dc7-8e02-0af145fd00df None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:57.572038 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a18cf-c582-45b9-b338-33d4f391df8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:57.572699 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a18cf-c582-45b9-b338-33d4f391df8e None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:57.572987 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a18cf-c582-45b9-b338-33d4f391df8e None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:57.573268 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a18cf-c582-45b9-b338-33d4f391df8e None admin] PATH_INFO: `/v3/users` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:57.574089 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2a18cf-c582-45b9-b338-33d4f391df8e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:54:57.574397 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2a18cf-c582-45b9-b338-33d4f391df8e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:57.575836 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2a18cf-c582-45b9-b338-33d4f391df8e None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:57.591986 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 446/902] 10.222.0.44 () {56 vars in 1143 bytes} [Wed May 25 11:54:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:54:57.598140 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6fc522-f134-4418-99d6-489fb489ff30 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:57.685085 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:54:57.700200 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6fc522-f134-4418-99d6-489fb489ff30 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:57.733608 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4bf117-d6e5-4dd5-a229-4edc00b26f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:57.734250 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4bf117-d6e5-4dd5-a229-4edc00b26f4d None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:57.734537 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4bf117-d6e5-4dd5-a229-4edc00b26f4d None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:57.734817 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4bf117-d6e5-4dd5-a229-4edc00b26f4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:57.799526 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4bf117-d6e5-4dd5-a229-4edc00b26f4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:57.801104 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4bf117-d6e5-4dd5-a229-4edc00b26f4d None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:57.881224 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:54:57.897955 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 457/903] 10.222.0.44 () {58 vars in 1282 bytes} [Wed May 25 11:54:57 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 11:54:57.903719 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a18cf-c582-45b9-b338-33d4f391df8e None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:57.964058 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:54:58.001300 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a18cf-c582-45b9-b338-33d4f391df8e None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:58.040415 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc646891-0876-4d3d-83fa-c02901433030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:58.041223 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc646891-0876-4d3d-83fa-c02901433030 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:58.041509 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc646891-0876-4d3d-83fa-c02901433030 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:58.041790 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc646891-0876-4d3d-83fa-c02901433030 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:58.051753 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc646891-0876-4d3d-83fa-c02901433030 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:58.053226 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc646891-0876-4d3d-83fa-c02901433030 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:58.072593 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-cc646891-0876-4d3d-83fa-c02901433030 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:54:58.072593 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:54:58.072593 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:54:58.072593 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:54:58.072593 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:54:58.072593 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:54:58.072593 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:54:58.072593 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:54:58.072593 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:54:58.072593 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:54:58.072593 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:54:58.072593 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:54:58.072593 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 11:54:58.072593 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 11:54:58.072593 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 11:54:58.073686 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 11:54:58.073686 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:54:58.073686 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:54:58.073686 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:54:58.073686 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:54:58.073686 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:54:58.073686 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:54:58.073686 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:54:58.073686 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:54:58.073686 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:54:58.073686 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:54:58.073686 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:54:58.073686 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:54:58.073686 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:54:58.073686 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:54:58.073686 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:54:58.073686 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:54:58.074802 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 11:54:58.074802 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 11:54:58.074802 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 11:54:58.074802 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:54:58.074802 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 447/904] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:54:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:54:58.079436 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4bf117-d6e5-4dd5-a229-4edc00b26f4d None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:58.174288 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4bf117-d6e5-4dd5-a229-4edc00b26f4d None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:58.207772 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15026de-1e02-4b8a-91ea-63711d9dfa06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:58.208460 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15026de-1e02-4b8a-91ea-63711d9dfa06 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:58.208748 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15026de-1e02-4b8a-91ea-63711d9dfa06 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:58.209049 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15026de-1e02-4b8a-91ea-63711d9dfa06 None admin] PATH_INFO: `/v3/domains` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:58.209760 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15026de-1e02-4b8a-91ea-63711d9dfa06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:54:58.210069 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15026de-1e02-4b8a-91ea-63711d9dfa06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:58.211430 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15026de-1e02-4b8a-91ea-63711d9dfa06 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:58.222341 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 458/905] 10.222.0.44 () {56 vars in 1109 bytes} [Wed May 25 11:54:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:54:58.227771 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc646891-0876-4d3d-83fa-c02901433030 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:58.322982 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc646891-0876-4d3d-83fa-c02901433030 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:58.344254 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:54:58.373776 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d3538a-413b-404d-9d2f-e62b5ae7e561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:58.374576 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3538a-413b-404d-9d2f-e62b5ae7e561 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:58.374862 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3538a-413b-404d-9d2f-e62b5ae7e561 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:58.375139 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3538a-413b-404d-9d2f-e62b5ae7e561 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:58.382402 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d3538a-413b-404d-9d2f-e62b5ae7e561 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:58.383872 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d3538a-413b-404d-9d2f-e62b5ae7e561 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:58.399843 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application [None req-92d3538a-413b-404d-9d2f-e62b5ae7e561 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 11:54:58.399843 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:54:58.399843 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:54:58.399843 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:54:58.399843 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:54:58.399843 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:54:58.399843 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:54:58.399843 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:54:58.399843 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:54:58.399843 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:54:58.399843 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:54:58.399843 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:54:58.399843 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 11:54:58.399843 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 11:54:58.399843 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 11:54:58.400711 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 11:54:58.400711 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:54:58.400711 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:54:58.400711 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:54:58.400711 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:54:58.400711 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:54:58.400711 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:54:58.400711 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:54:58.400711 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application with Lock( May 25 11:54:58.400711 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:54:58.400711 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._enter() May 25 11:54:58.400711 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:54:58.400711 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:54:58.400711 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:54:58.400711 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.creator() May 25 11:54:58.400711 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:54:58.400711 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application created_value = creator( May 25 11:54:58.401613 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 11:54:58.401613 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 11:54:58.401613 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 11:54:58.401613 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 11:54:58.401613 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 11:54:58.401613 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 11:54:58.401613 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 11:54:58.401613 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: ERROR keystone.server.flask.application May 25 11:54:58.401613 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 448/906] 10.222.0.44 () {56 vars in 1111 bytes} [Wed May 25 11:54:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:54:58.406814 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15026de-1e02-4b8a-91ea-63711d9dfa06 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:58.452359 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:54:58.502943 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15026de-1e02-4b8a-91ea-63711d9dfa06 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:58.535411 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857516c-2738-42ea-a25a-7819b35359c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:58.536081 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857516c-2738-42ea-a25a-7819b35359c6 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:58.536376 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857516c-2738-42ea-a25a-7819b35359c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:58.536648 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857516c-2738-42ea-a25a-7819b35359c6 None admin] PATH_INFO: `/v3/projects` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:58.537426 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c857516c-2738-42ea-a25a-7819b35359c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:54:58.537738 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c857516c-2738-42ea-a25a-7819b35359c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:58.539172 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c857516c-2738-42ea-a25a-7819b35359c6 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:58.552667 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 459/907] 10.222.0.44 () {56 vars in 1148 bytes} [Wed May 25 11:54:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:54:58.558622 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d3538a-413b-404d-9d2f-e62b5ae7e561 None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:54:58.654622 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d3538a-413b-404d-9d2f-e62b5ae7e561 None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:54:58.701571 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c38e47d-8701-46af-acd9-9195424fb8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:54:58.702229 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38e47d-8701-46af-acd9-9195424fb8bc None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:54:58.702511 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38e47d-8701-46af-acd9-9195424fb8bc None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:54:58.702783 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38e47d-8701-46af-acd9-9195424fb8bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:54:58.705537 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c38e47d-8701-46af-acd9-9195424fb8bc None admin] RBAC: Adding query filter params (role.id=2fe5c1214bcc4c1bafa5a4545161518d, scope.project.id=57e08d47948142978437098a8120be78, user.id=94f4a0c602a7495dbb36dd768cc55a47) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:54:58.705853 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c38e47d-8701-46af-acd9-9195424fb8bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:54:58.707330 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c38e47d-8701-46af-acd9-9195424fb8bc None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:54:58.713719 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 449/908] 10.222.0.44 () {56 vars in 1374 bytes} [Wed May 25 11:54:58 2022] GET /identity/v3/role_assignments?user.id=94f4a0c602a7495dbb36dd768cc55a47&scope.project.id=57e08d47948142978437098a8120be78&role.id=2fe5c1214bcc4c1bafa5a4545161518d => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:55:00.977955 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb06a8-c549-4380-b857-8c475b77cc9b None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:55:00.978495 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb06a8-c549-4380-b857-8c475b77cc9b None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:55:00.978495 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb06a8-c549-4380-b857-8c475b77cc9b None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:55:00.979972 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 460/909] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:55:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:55:00.984976 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a87e0-2c87-4325-8f46-6efab4684abe None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:55:00.985372 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a87e0-2c87-4325-8f46-6efab4684abe None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:55:00.985541 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a87e0-2c87-4325-8f46-6efab4684abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:55:01.001808 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-830a87e0-2c87-4325-8f46-6efab4684abe None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:55:01.002993 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-830a87e0-2c87-4325-8f46-6efab4684abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:55:01.031599 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:55:01.067948 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 450/910] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:55:00 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 11:55:01.091103 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb06a8-c549-4380-b857-8c475b77cc9b None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:55:01.190477 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb06a8-c549-4380-b857-8c475b77cc9b None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:55:01.197576 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:55:01.223774 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62faafdb-5db8-4931-8958-96d4f9572089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:55:01.224585 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62faafdb-5db8-4931-8958-96d4f9572089 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:55:01.224866 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62faafdb-5db8-4931-8958-96d4f9572089 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:55:01.225140 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62faafdb-5db8-4931-8958-96d4f9572089 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:55:01.225780 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62faafdb-5db8-4931-8958-96d4f9572089 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:55:01.227150 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62faafdb-5db8-4931-8958-96d4f9572089 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:55:01.238648 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-62faafdb-5db8-4931-8958-96d4f9572089 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 25 11:55:01.238648 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:55:01.238648 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 11:55:01.238648 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 11:55:01.238648 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 11:55:01.238648 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 11:55:01.238648 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 11:55:01.238648 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 11:55:01.238648 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 11:55:01.238648 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:55:01.238648 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 11:55:01.238648 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:55:01.238648 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:55:01.238648 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:55:01.238648 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:55:01.238648 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:55:01.238648 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:55:01.239855 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:55:01.239855 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:55:01.239855 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:55:01.239855 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:55:01.239855 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:55:01.239855 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:55:01.239855 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 11:55:01.239855 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 11:55:01.239855 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 11:55:01.239855 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 11:55:01.239855 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:55:01.239855 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:55:01.239855 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:55:01.239855 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:55:01.239855 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:55:01.239855 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:55:01.240936 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:55:01.240936 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:55:01.240936 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:55:01.240936 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:55:01.240936 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:55:01.240936 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:55:01.240936 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:55:01.240936 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:55:01.240936 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:55:01.240936 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:55:01.240936 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 11:55:01.240936 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 11:55:01.240936 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 11:55:01.240936 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:55:01.240936 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 461/911] 10.222.0.44 () {56 vars in 1117 bytes} [Wed May 25 11:55:01 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:55:01.246904 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a87e0-2c87-4325-8f46-6efab4684abe None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:55:01.341096 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a87e0-2c87-4325-8f46-6efab4684abe None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:55:01.372393 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd70c19-4d6a-42d5-94d1-7643194bfaae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:55:01.373036 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd70c19-4d6a-42d5-94d1-7643194bfaae None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:55:01.373319 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd70c19-4d6a-42d5-94d1-7643194bfaae None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:55:01.373595 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd70c19-4d6a-42d5-94d1-7643194bfaae None admin] PATH_INFO: `/v3/services` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:55:01.374286 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd70c19-4d6a-42d5-94d1-7643194bfaae None admin] RBAC: Adding query filter params (name=placement) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:55:01.374591 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd70c19-4d6a-42d5-94d1-7643194bfaae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:55:01.375987 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd70c19-4d6a-42d5-94d1-7643194bfaae None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:55:01.381066 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 451/912] 10.222.0.44 () {56 vars in 1116 bytes} [Wed May 25 11:55:01 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:55:01.386575 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62faafdb-5db8-4931-8958-96d4f9572089 None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:55:01.482038 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62faafdb-5db8-4931-8958-96d4f9572089 None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:55:01.514126 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956c47aa-98d5-4cdc-bf5f-13a9e147b0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:55:01.514709 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c47aa-98d5-4cdc-bf5f-13a9e147b0fe None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:55:01.514993 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c47aa-98d5-4cdc-bf5f-13a9e147b0fe None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:55:01.515271 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c47aa-98d5-4cdc-bf5f-13a9e147b0fe None admin] PATH_INFO: `/v3/services` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:55:01.515990 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956c47aa-98d5-4cdc-bf5f-13a9e147b0fe None admin] RBAC: Adding query filter params (type=placement) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:55:01.516297 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956c47aa-98d5-4cdc-bf5f-13a9e147b0fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:55:01.517909 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956c47aa-98d5-4cdc-bf5f-13a9e147b0fe None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:55:01.522737 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 462/913] 10.222.0.44 () {56 vars in 1116 bytes} [Wed May 25 11:55:01 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:55:03.769858 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f23b355-62b2-44da-b82f-11ab313cb5b7 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:55:03.770438 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f23b355-62b2-44da-b82f-11ab313cb5b7 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:55:03.770675 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f23b355-62b2-44da-b82f-11ab313cb5b7 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:55:03.772514 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 452/914] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:55:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:55:03.777703 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183710d1-d489-4fa6-bb6f-7ef8e2da9e4b None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:55:03.778152 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183710d1-d489-4fa6-bb6f-7ef8e2da9e4b None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:55:03.778274 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183710d1-d489-4fa6-bb6f-7ef8e2da9e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:55:03.795282 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-183710d1-d489-4fa6-bb6f-7ef8e2da9e4b None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:55:03.796514 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-183710d1-d489-4fa6-bb6f-7ef8e2da9e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:55:03.821765 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:55:03.861173 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 463/915] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:55:03 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 11:55:03.884087 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f23b355-62b2-44da-b82f-11ab313cb5b7 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:55:03.919945 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:55:03.987412 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f23b355-62b2-44da-b82f-11ab313cb5b7 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:55:04.020819 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4cff98-79ab-4569-9ba7-e1b2365d634f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:55:04.021418 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4cff98-79ab-4569-9ba7-e1b2365d634f None admin] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:55:04.021705 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4cff98-79ab-4569-9ba7-e1b2365d634f None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:55:04.021991 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4cff98-79ab-4569-9ba7-e1b2365d634f None admin] PATH_INFO: `/v3/services` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:55:04.022708 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4cff98-79ab-4569-9ba7-e1b2365d634f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:55:04.024101 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4cff98-79ab-4569-9ba7-e1b2365d634f None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:55:04.036858 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 453/916] 10.222.0.44 () {60 vars in 1141 bytes} [Wed May 25 11:55:03 2022] POST /identity/v3/services => generated 246 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 11:55:06.281422 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b5ba8-6796-4c95-98fe-1b1120b81137 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:55:06.281949 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b5ba8-6796-4c95-98fe-1b1120b81137 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:55:06.282063 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b5ba8-6796-4c95-98fe-1b1120b81137 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:55:06.283325 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 464/917] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:55:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:55:06.288914 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111de6ee-cbff-48e9-9473-e8c7140eb6d1 None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:55:06.289297 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111de6ee-cbff-48e9-9473-e8c7140eb6d1 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:55:06.289471 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111de6ee-cbff-48e9-9473-e8c7140eb6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:55:06.306456 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-111de6ee-cbff-48e9-9473-e8c7140eb6d1 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:55:06.307640 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-111de6ee-cbff-48e9-9473-e8c7140eb6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:55:06.376631 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 454/918] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:55:06 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 11:55:06.399972 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7b5ba8-6796-4c95-98fe-1b1120b81137 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:55:06.496639 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7b5ba8-6796-4c95-98fe-1b1120b81137 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:55:06.549016 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e4f0a-c712-4df0-b141-308c3b81a11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:55:06.549817 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e4f0a-c712-4df0-b141-308c3b81a11a None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:55:06.550748 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e4f0a-c712-4df0-b141-308c3b81a11a None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:55:06.551026 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e4f0a-c712-4df0-b141-308c3b81a11a None admin] PATH_INFO: `/v3/services/placement` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:55:06.551689 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320e4f0a-c712-4df0-b141-308c3b81a11a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:55:06.553113 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320e4f0a-c712-4df0-b141-308c3b81a11a None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:55:06.565828 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-320e4f0a-c712-4df0-b141-308c3b81a11a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 25 11:55:06.565828 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:55:06.565828 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 11:55:06.565828 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 11:55:06.565828 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 11:55:06.565828 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 11:55:06.565828 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 11:55:06.565828 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 11:55:06.565828 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 11:55:06.565828 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:55:06.565828 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 11:55:06.565828 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:55:06.565828 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:55:06.565828 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:55:06.565828 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:55:06.565828 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:55:06.565828 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:55:06.566856 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:55:06.566856 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:55:06.566856 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:55:06.566856 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:55:06.566856 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:55:06.566856 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:55:06.566856 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 11:55:06.566856 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 11:55:06.566856 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 11:55:06.566856 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 11:55:06.566856 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:55:06.566856 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:55:06.566856 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:55:06.566856 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:55:06.566856 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:55:06.566856 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:55:06.568597 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:55:06.568597 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:55:06.568597 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:55:06.568597 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:55:06.568597 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:55:06.568597 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:55:06.568597 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:55:06.568597 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:55:06.568597 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:55:06.568597 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:55:06.568597 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 11:55:06.568597 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 11:55:06.568597 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 11:55:06.568597 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:55:06.568597 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 465/919] 10.222.0.44 () {56 vars in 1117 bytes} [Wed May 25 11:55:06 2022] GET /identity/v3/services/placement => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:55:06.574609 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111de6ee-cbff-48e9-9473-e8c7140eb6d1 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:55:06.599338 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:55:06.686186 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111de6ee-cbff-48e9-9473-e8c7140eb6d1 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:55:06.720859 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8b5af-994d-4e14-8bee-e661d83b6f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:55:06.721535 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8b5af-994d-4e14-8bee-e661d83b6f1d None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:55:06.721861 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8b5af-994d-4e14-8bee-e661d83b6f1d None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:55:06.722684 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8b5af-994d-4e14-8bee-e661d83b6f1d None admin] PATH_INFO: `/v3/services` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:55:06.723389 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a8b5af-994d-4e14-8bee-e661d83b6f1d None admin] RBAC: Adding query filter params (name=placement) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:55:06.723697 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a8b5af-994d-4e14-8bee-e661d83b6f1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:55:06.725179 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a8b5af-994d-4e14-8bee-e661d83b6f1d None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:55:06.730490 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 455/920] 10.222.0.44 () {56 vars in 1116 bytes} [Wed May 25 11:55:06 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:55:06.736490 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e4f0a-c712-4df0-b141-308c3b81a11a None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:55:06.768500 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:55:06.849010 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e4f0a-c712-4df0-b141-308c3b81a11a None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:55:06.881296 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b559e-fb79-47d8-a544-b395eb354416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:55:06.881932 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b559e-fb79-47d8-a544-b395eb354416 None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:55:06.882211 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b559e-fb79-47d8-a544-b395eb354416 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:55:06.882483 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b559e-fb79-47d8-a544-b395eb354416 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:55:06.883247 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38b559e-fb79-47d8-a544-b395eb354416 None admin] RBAC: Adding query filter params (interface=public, service_id=fcd0d2024ead4dd2899eacb172f47231, region_id=RegionOne) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:55:06.883561 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38b559e-fb79-47d8-a544-b395eb354416 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:55:06.884954 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38b559e-fb79-47d8-a544-b395eb354416 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:55:06.889754 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 466/921] 10.222.0.44 () {56 vars in 1251 bytes} [Wed May 25 11:55:06 2022] GET /identity/v3/endpoints?service_id=fcd0d2024ead4dd2899eacb172f47231&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:55:06.896198 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8b5af-994d-4e14-8bee-e661d83b6f1d None admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:55:06.973208 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:55:06.990640 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8b5af-994d-4e14-8bee-e661d83b6f1d None admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:55:07.022875 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f456bbb-5549-4478-8124-a9b936b18744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:55:07.023467 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f456bbb-5549-4478-8124-a9b936b18744 None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:55:07.023746 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f456bbb-5549-4478-8124-a9b936b18744 None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:55:07.024059 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f456bbb-5549-4478-8124-a9b936b18744 None admin] PATH_INFO: `/v3/services` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:55:07.024720 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f456bbb-5549-4478-8124-a9b936b18744 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:55:07.026065 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f456bbb-5549-4478-8124-a9b936b18744 None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:55:07.032335 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 456/922] 10.222.0.44 () {56 vars in 1087 bytes} [Wed May 25 11:55:06 2022] GET /identity/v3/services => generated 1962 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 11:55:09.264132 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd631aad-04f5-4400-8ec5-cd53e6b71487 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:55:09.264655 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd631aad-04f5-4400-8ec5-cd53e6b71487 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:55:09.264758 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd631aad-04f5-4400-8ec5-cd53e6b71487 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:55:09.266043 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 467/923] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:55:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:55:09.271450 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd39ae5e-a3c6-4daf-b1f4-f4a25e26ed07 None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:55:09.271889 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd39ae5e-a3c6-4daf-b1f4-f4a25e26ed07 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:55:09.272048 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd39ae5e-a3c6-4daf-b1f4-f4a25e26ed07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:55:09.288655 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-cd39ae5e-a3c6-4daf-b1f4-f4a25e26ed07 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:55:09.289827 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-cd39ae5e-a3c6-4daf-b1f4-f4a25e26ed07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:55:09.353735 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 457/924] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:55:09 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 11:55:09.377172 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd631aad-04f5-4400-8ec5-cd53e6b71487 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:55:09.465734 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:55:09.476150 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd631aad-04f5-4400-8ec5-cd53e6b71487 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:55:09.507713 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429a660d-4390-4bd3-898d-3e48ed27d21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:55:09.508493 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a660d-4390-4bd3-898d-3e48ed27d21c None admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:55:09.508774 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a660d-4390-4bd3-898d-3e48ed27d21c None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:55:09.509046 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a660d-4390-4bd3-898d-3e48ed27d21c None admin] PATH_INFO: `/v3/services/placement` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:55:09.509682 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429a660d-4390-4bd3-898d-3e48ed27d21c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:55:09.511031 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429a660d-4390-4bd3-898d-3e48ed27d21c None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:55:09.522839 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application [None req-429a660d-4390-4bd3-898d-3e48ed27d21c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 25 11:55:09.522839 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:55:09.522839 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 11:55:09.522839 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 11:55:09.522839 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 11:55:09.522839 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 11:55:09.522839 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 11:55:09.522839 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 11:55:09.522839 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 11:55:09.522839 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:55:09.522839 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 11:55:09.522839 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:55:09.522839 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 11:55:09.522839 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 11:55:09.522839 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 11:55:09.522839 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 11:55:09.522839 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 11:55:09.524015 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 11:55:09.524015 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 11:55:09.524015 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 11:55:09.524015 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 11:55:09.524015 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 11:55:09.524015 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 11:55:09.524015 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 11:55:09.524015 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 11:55:09.524015 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 11:55:09.524015 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 11:55:09.524015 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 11:55:09.524015 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 11:55:09.524015 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 11:55:09.524015 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 11:55:09.524015 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 11:55:09.524015 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.get_or_create( May 25 11:55:09.524864 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 11:55:09.524864 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application with Lock( May 25 11:55:09.524864 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 11:55:09.524864 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self._enter() May 25 11:55:09.524864 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 11:55:09.524864 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 11:55:09.524864 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 11:55:09.524864 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application return self.creator() May 25 11:55:09.524864 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 11:55:09.524864 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application created_value = creator( May 25 11:55:09.524864 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 11:55:09.524864 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 11:55:09.524864 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 11:55:09.524864 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: ERROR keystone.server.flask.application May 25 11:55:09.524864 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 468/925] 10.222.0.44 () {56 vars in 1117 bytes} [Wed May 25 11:55:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 11:55:09.531159 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd39ae5e-a3c6-4daf-b1f4-f4a25e26ed07 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:55:09.602863 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:55:09.624885 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd39ae5e-a3c6-4daf-b1f4-f4a25e26ed07 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:55:09.656434 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959938c7-a5d6-457a-8bb7-981813aa322d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:55:09.657080 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959938c7-a5d6-457a-8bb7-981813aa322d None admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:55:09.657361 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959938c7-a5d6-457a-8bb7-981813aa322d None admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:55:09.657635 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959938c7-a5d6-457a-8bb7-981813aa322d None admin] PATH_INFO: `/v3/services` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:55:09.658321 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959938c7-a5d6-457a-8bb7-981813aa322d None admin] RBAC: Adding query filter params (name=placement) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 11:55:09.658622 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959938c7-a5d6-457a-8bb7-981813aa322d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:55:09.660506 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959938c7-a5d6-457a-8bb7-981813aa322d None admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:55:09.665404 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 458/926] 10.222.0.44 () {56 vars in 1116 bytes} [Wed May 25 11:55:09 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 11:55:09.671031 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429a660d-4390-4bd3-898d-3e48ed27d21c None admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:55:09.766186 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429a660d-4390-4bd3-898d-3e48ed27d21c None admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:55:09.798689 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b39e4-51c4-40b3-885b-9d688a4f5fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:55:09.799323 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b39e4-51c4-40b3-885b-9d688a4f5fc2 None admin] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:55:09.799605 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b39e4-51c4-40b3-885b-9d688a4f5fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:55:09.799909 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b39e4-51c4-40b3-885b-9d688a4f5fc2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:55:09.800662 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4b39e4-51c4-40b3-885b-9d688a4f5fc2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:55:09.802018 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4b39e4-51c4-40b3-885b-9d688a4f5fc2 None admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:55:09.820081 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 469/927] 10.222.0.44 () {60 vars in 1144 bytes} [Wed May 25 11:55:09 2022] POST /identity/v3/endpoints => generated 331 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 11:55:19.662534 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=30 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:55:19.816330 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:56:08.037426 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe7b69-e64a-40ef-8fb4-3b7cf294f536 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:56:08.037426 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe7b69-e64a-40ef-8fb4-3b7cf294f536 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:56:08.038003 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe7b69-e64a-40ef-8fb4-3b7cf294f536 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:56:08.042688 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 459/928] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:56:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:56:08.044124 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b2b93-4101-4cf6-95b3-e0caad6076d9 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:56:08.044558 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b2b93-4101-4cf6-95b3-e0caad6076d9 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:56:08.044664 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b2b93-4101-4cf6-95b3-e0caad6076d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:56:08.072891 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-1b5b2b93-4101-4cf6-95b3-e0caad6076d9 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:56:08.076267 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-1b5b2b93-4101-4cf6-95b3-e0caad6076d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:56:08.196276 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 470/929] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:56:08 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 11:56:08.241752 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076799d3-db36-4fc1-a7c3-b08de4b60ea0 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:56:08.242124 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076799d3-db36-4fc1-a7c3-b08de4b60ea0 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:56:08.243250 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076799d3-db36-4fc1-a7c3-b08de4b60ea0 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:56:08.243967 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 460/930] 10.222.0.44 () {54 vars in 964 bytes} [Wed May 25 11:56:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:56:08.250090 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6f44e-1928-4d81-a05f-e852346dc03d None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:56:08.250390 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6f44e-1928-4d81-a05f-e852346dc03d None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:56:08.250668 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6f44e-1928-4d81-a05f-e852346dc03d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:56:08.315068 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-04f6f44e-1928-4d81-a05f-e852346dc03d None None] MFA Rules not processed for user `be63af25271b49b5903e8fe66a62b1d2`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:56:08.316851 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-04f6f44e-1928-4d81-a05f-e852346dc03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:56:08.379513 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 471/931] 10.222.0.44 () {58 vars in 1061 bytes} [Wed May 25 11:56:08 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 11:56:08.389990 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076799d3-db36-4fc1-a7c3-b08de4b60ea0 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:56:08.402967 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076799d3-db36-4fc1-a7c3-b08de4b60ea0 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:56:08.406599 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bece464-8a95-4798-a5a4-3190639e225b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be63af25271b49b5903e8fe66a62b1d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:56:08.407327 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bece464-8a95-4798-a5a4-3190639e225b service neutron] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:56:08.407619 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bece464-8a95-4798-a5a4-3190639e225b service neutron] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:56:08.407770 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bece464-8a95-4798-a5a4-3190639e225b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:56:08.418188 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bece464-8a95-4798-a5a4-3190639e225b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:56:08.419731 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bece464-8a95-4798-a5a4-3190639e225b service neutron] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:56:08.433757 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 461/932] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 11:56:08 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 11:56:10.969538 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814e25f-60b1-4a39-a612-740f09214625 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:56:10.970131 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814e25f-60b1-4a39-a612-740f09214625 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:56:10.970131 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814e25f-60b1-4a39-a612-740f09214625 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:56:10.971820 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 472/933] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:56:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:56:10.978238 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9bb72-91d5-417e-83d0-4e2f7d7609d7 None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:56:10.978762 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9bb72-91d5-417e-83d0-4e2f7d7609d7 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:56:10.978882 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9bb72-91d5-417e-83d0-4e2f7d7609d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:56:10.997271 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-05f9bb72-91d5-417e-83d0-4e2f7d7609d7 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:56:10.998470 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-05f9bb72-91d5-417e-83d0-4e2f7d7609d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:56:11.006542 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 462/934] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:56:10 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 11:56:11.046516 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3814e25f-60b1-4a39-a612-740f09214625 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:56:11.057756 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3814e25f-60b1-4a39-a612-740f09214625 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:56:11.061167 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd0491-8dec-4b87-8102-8d0cff5f5f9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be63af25271b49b5903e8fe66a62b1d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:56:11.061823 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd0491-8dec-4b87-8102-8d0cff5f5f9c service neutron] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:56:11.062102 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd0491-8dec-4b87-8102-8d0cff5f5f9c service neutron] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:56:11.062375 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd0491-8dec-4b87-8102-8d0cff5f5f9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:56:11.071430 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cd0491-8dec-4b87-8102-8d0cff5f5f9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:56:11.072892 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cd0491-8dec-4b87-8102-8d0cff5f5f9c service neutron] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:56:11.082731 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 473/935] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 11:56:11 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 11:56:13.673092 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c603f-bf11-4710-bb15-e82dc89133de None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:56:13.674006 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c603f-bf11-4710-bb15-e82dc89133de None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:56:13.674292 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c603f-bf11-4710-bb15-e82dc89133de None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:56:13.675899 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 463/936] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:56:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:56:13.680914 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78c9c9-dc70-43a8-8012-734b4e55b5dd None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:56:13.681339 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78c9c9-dc70-43a8-8012-734b4e55b5dd None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:56:13.681544 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78c9c9-dc70-43a8-8012-734b4e55b5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:56:13.724145 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-2c78c9c9-dc70-43a8-8012-734b4e55b5dd None None] MFA Rules not processed for user `d56e0746442f4c68951b0eae41c997d3`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:56:13.725361 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-2c78c9c9-dc70-43a8-8012-734b4e55b5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:56:13.765957 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:56:13.803850 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 474/937] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:56:13 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 11:56:13.858638 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c233ce58-bfc5-4905-add9-0c40bc652c8b None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:56:13.859756 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c233ce58-bfc5-4905-add9-0c40bc652c8b None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:56:13.860189 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c233ce58-bfc5-4905-add9-0c40bc652c8b None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:56:13.861721 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 464/938] 10.222.0.44 () {54 vars in 964 bytes} [Wed May 25 11:56:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:56:13.868297 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d00ba-e744-4ea5-9f55-43d65ba3c825 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:56:13.868620 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d00ba-e744-4ea5-9f55-43d65ba3c825 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:56:13.868855 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d00ba-e744-4ea5-9f55-43d65ba3c825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:56:13.888602 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-026d00ba-e744-4ea5-9f55-43d65ba3c825 None None] MFA Rules not processed for user `be63af25271b49b5903e8fe66a62b1d2`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:56:13.889685 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-026d00ba-e744-4ea5-9f55-43d65ba3c825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:56:13.898150 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 475/939] 10.222.0.44 () {58 vars in 1061 bytes} [Wed May 25 11:56:13 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 11:56:13.907514 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c233ce58-bfc5-4905-add9-0c40bc652c8b None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:56:13.918641 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c233ce58-bfc5-4905-add9-0c40bc652c8b None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:56:13.922275 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd624696-9e57-4247-b05d-fec698b7a704 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be63af25271b49b5903e8fe66a62b1d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:56:13.922997 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd624696-9e57-4247-b05d-fec698b7a704 service neutron] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:56:13.923335 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd624696-9e57-4247-b05d-fec698b7a704 service neutron] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:56:13.923546 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd624696-9e57-4247-b05d-fec698b7a704 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:56:13.933572 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd624696-9e57-4247-b05d-fec698b7a704 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:56:13.935053 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd624696-9e57-4247-b05d-fec698b7a704 service neutron] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:56:13.946623 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 465/940] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 11:56:13 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 11:56:17.329829 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e06cf5-632a-4a67-a776-81f3ce70732b None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:56:17.330347 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e06cf5-632a-4a67-a776-81f3ce70732b None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:56:17.330347 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e06cf5-632a-4a67-a776-81f3ce70732b None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:56:17.331711 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 476/941] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:56:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:56:17.336843 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2472126-a775-41cf-9244-2c36f5208f04 None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:56:17.337276 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2472126-a775-41cf-9244-2c36f5208f04 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:56:17.337402 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2472126-a775-41cf-9244-2c36f5208f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:56:17.355494 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-b2472126-a775-41cf-9244-2c36f5208f04 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:56:17.356712 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-b2472126-a775-41cf-9244-2c36f5208f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:56:17.421080 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 466/942] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:56:17 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 11:56:17.461520 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e06cf5-632a-4a67-a776-81f3ce70732b None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:56:17.471750 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e06cf5-632a-4a67-a776-81f3ce70732b None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:56:17.475133 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352d1d7-dcef-4533-8486-968722829a5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be63af25271b49b5903e8fe66a62b1d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:56:17.475754 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352d1d7-dcef-4533-8486-968722829a5e service neutron] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:56:17.476061 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352d1d7-dcef-4533-8486-968722829a5e service neutron] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:56:17.476333 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352d1d7-dcef-4533-8486-968722829a5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:56:17.484867 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9352d1d7-dcef-4533-8486-968722829a5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:56:17.486303 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9352d1d7-dcef-4533-8486-968722829a5e service neutron] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:56:17.495856 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 477/943] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 11:56:17 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 11:56:20.419938 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826273c8-618e-4ab8-92cb-8ff33d9e1d0d None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:56:20.420610 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826273c8-618e-4ab8-92cb-8ff33d9e1d0d None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:56:20.420610 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826273c8-618e-4ab8-92cb-8ff33d9e1d0d None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:56:20.421868 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 467/944] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:56:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:56:20.427123 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca41929-4a3c-4f00-af9e-12cd762a0454 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:56:20.427558 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca41929-4a3c-4f00-af9e-12cd762a0454 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:56:20.427760 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca41929-4a3c-4f00-af9e-12cd762a0454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:56:20.446809 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-0ca41929-4a3c-4f00-af9e-12cd762a0454 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:56:20.448043 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-0ca41929-4a3c-4f00-af9e-12cd762a0454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:56:20.455688 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 478/945] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:56:20 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 11:56:20.493578 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826273c8-618e-4ab8-92cb-8ff33d9e1d0d None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:56:20.507241 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826273c8-618e-4ab8-92cb-8ff33d9e1d0d None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:56:20.511169 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a632664d-20e2-4c4d-a52e-73cdbe3785c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be63af25271b49b5903e8fe66a62b1d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:56:20.511871 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632664d-20e2-4c4d-a52e-73cdbe3785c4 service neutron] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:56:20.512147 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632664d-20e2-4c4d-a52e-73cdbe3785c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:56:20.512419 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632664d-20e2-4c4d-a52e-73cdbe3785c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:56:20.522189 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a632664d-20e2-4c4d-a52e-73cdbe3785c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:56:20.523598 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a632664d-20e2-4c4d-a52e-73cdbe3785c4 service neutron] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:56:20.532694 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 468/946] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 11:56:20 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 11:56:22.924571 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf37a5b-327c-4518-99f4-484c9dc9bb50 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:56:22.925168 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf37a5b-327c-4518-99f4-484c9dc9bb50 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:56:22.925858 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf37a5b-327c-4518-99f4-484c9dc9bb50 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:56:22.927205 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 479/947] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:56:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:56:22.932352 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c5d08-5150-40d8-95ab-6a5a61ecb0b7 None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:56:22.932762 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c5d08-5150-40d8-95ab-6a5a61ecb0b7 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:56:22.932913 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c5d08-5150-40d8-95ab-6a5a61ecb0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:56:22.950089 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-c67c5d08-5150-40d8-95ab-6a5a61ecb0b7 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:56:22.951255 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-c67c5d08-5150-40d8-95ab-6a5a61ecb0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:56:22.958885 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 469/948] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:56:22 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 11:56:22.996877 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf37a5b-327c-4518-99f4-484c9dc9bb50 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:56:23.007245 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf37a5b-327c-4518-99f4-484c9dc9bb50 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:56:23.010679 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d722ec-4218-4b6a-9e7c-15c0fb265f21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be63af25271b49b5903e8fe66a62b1d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:56:23.011308 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d722ec-4218-4b6a-9e7c-15c0fb265f21 service neutron] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:56:23.011588 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d722ec-4218-4b6a-9e7c-15c0fb265f21 service neutron] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:56:23.011889 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d722ec-4218-4b6a-9e7c-15c0fb265f21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:56:23.021932 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d722ec-4218-4b6a-9e7c-15c0fb265f21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:56:23.024386 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d722ec-4218-4b6a-9e7c-15c0fb265f21 service neutron] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:56:23.033967 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 480/949] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 11:56:22 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 11:56:25.334034 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd4275-6381-4e91-a981-e7369df7fbcd None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:56:25.334602 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd4275-6381-4e91-a981-e7369df7fbcd None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:56:25.334602 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd4275-6381-4e91-a981-e7369df7fbcd None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:56:25.335991 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 470/950] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:56:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:56:25.341219 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6cefec-a465-4078-8e9c-0669493a88ab None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:56:25.341624 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6cefec-a465-4078-8e9c-0669493a88ab None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:56:25.341809 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6cefec-a465-4078-8e9c-0669493a88ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:56:25.360717 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-dd6cefec-a465-4078-8e9c-0669493a88ab None None] MFA Rules not processed for user `d56e0746442f4c68951b0eae41c997d3`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:56:25.361906 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-dd6cefec-a465-4078-8e9c-0669493a88ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:56:25.370176 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 481/951] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:56:25 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 11:56:25.408700 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd4275-6381-4e91-a981-e7369df7fbcd None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:56:25.419930 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd4275-6381-4e91-a981-e7369df7fbcd None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:56:25.423404 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a10451-0208-468e-ae15-2b78ef30e5b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be63af25271b49b5903e8fe66a62b1d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:56:25.424086 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a10451-0208-468e-ae15-2b78ef30e5b0 service neutron] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:56:25.424370 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a10451-0208-468e-ae15-2b78ef30e5b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:56:25.424643 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a10451-0208-468e-ae15-2b78ef30e5b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:56:25.434566 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a10451-0208-468e-ae15-2b78ef30e5b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:56:25.435966 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a10451-0208-468e-ae15-2b78ef30e5b0 service neutron] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:56:25.449644 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 471/952] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 11:56:25 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 11:56:27.965400 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c064db7-7b61-43f9-a2ae-a16223c92791 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:56:27.965926 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c064db7-7b61-43f9-a2ae-a16223c92791 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:56:27.966038 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c064db7-7b61-43f9-a2ae-a16223c92791 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:56:27.967306 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 482/953] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:56:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:56:27.973219 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f74a79-66d7-4b6a-b6ce-5c041a9c340b None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:56:27.973656 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f74a79-66d7-4b6a-b6ce-5c041a9c340b None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:56:27.973774 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f74a79-66d7-4b6a-b6ce-5c041a9c340b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:56:27.991005 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-e5f74a79-66d7-4b6a-b6ce-5c041a9c340b None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:56:27.992333 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-e5f74a79-66d7-4b6a-b6ce-5c041a9c340b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:56:28.000360 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 472/954] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:56:27 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 11:56:28.038384 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c064db7-7b61-43f9-a2ae-a16223c92791 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:56:28.048877 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c064db7-7b61-43f9-a2ae-a16223c92791 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:56:28.052372 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcce046-a052-4048-9d86-2adea3581a00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be63af25271b49b5903e8fe66a62b1d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:56:28.053002 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcce046-a052-4048-9d86-2adea3581a00 service neutron] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:56:28.053288 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcce046-a052-4048-9d86-2adea3581a00 service neutron] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:56:28.053565 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcce046-a052-4048-9d86-2adea3581a00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:56:28.062400 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcce046-a052-4048-9d86-2adea3581a00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:56:28.063882 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcce046-a052-4048-9d86-2adea3581a00 service neutron] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:56:28.074225 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 483/955] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 11:56:28 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 11:56:30.384322 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc87a7-a1d2-4ef7-afa8-1cac26c36fd2 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:56:30.384841 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc87a7-a1d2-4ef7-afa8-1cac26c36fd2 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:56:30.384841 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc87a7-a1d2-4ef7-afa8-1cac26c36fd2 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:56:30.386140 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 473/956] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:56:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:56:30.391299 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b428499e-03d0-4350-aecc-0f6c67e9ebfb None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:56:30.391725 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b428499e-03d0-4350-aecc-0f6c67e9ebfb None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:56:30.392136 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b428499e-03d0-4350-aecc-0f6c67e9ebfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:56:30.410079 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-b428499e-03d0-4350-aecc-0f6c67e9ebfb None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:56:30.411244 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-b428499e-03d0-4350-aecc-0f6c67e9ebfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:56:30.418786 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 484/957] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:56:30 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 11:56:30.459485 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc87a7-a1d2-4ef7-afa8-1cac26c36fd2 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:56:30.464758 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=65 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:56:30.470702 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc87a7-a1d2-4ef7-afa8-1cac26c36fd2 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:56:30.474249 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b4931-ba45-4351-bd6d-8877326c6c8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be63af25271b49b5903e8fe66a62b1d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:56:30.474957 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b4931-ba45-4351-bd6d-8877326c6c8f service neutron] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:56:30.475341 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b4931-ba45-4351-bd6d-8877326c6c8f service neutron] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:56:30.475679 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b4931-ba45-4351-bd6d-8877326c6c8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:56:30.484441 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b4931-ba45-4351-bd6d-8877326c6c8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:56:30.485899 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b4931-ba45-4351-bd6d-8877326c6c8f service neutron] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:56:30.495248 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 474/958] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 11:56:30 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 11:56:33.086278 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975bb68d-07d5-43f3-a9ab-ed1bef1776a7 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:56:33.086849 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975bb68d-07d5-43f3-a9ab-ed1bef1776a7 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:56:33.086849 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975bb68d-07d5-43f3-a9ab-ed1bef1776a7 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:56:33.088192 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 485/959] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:56:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:56:33.093294 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b2759-be6b-4c35-803a-409c3e32ef22 None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:56:33.093683 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b2759-be6b-4c35-803a-409c3e32ef22 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:56:33.093849 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b2759-be6b-4c35-803a-409c3e32ef22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:56:33.111067 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-548b2759-be6b-4c35-803a-409c3e32ef22 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:56:33.112305 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-548b2759-be6b-4c35-803a-409c3e32ef22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:56:33.124487 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 475/960] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:56:33 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 11:56:33.161446 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975bb68d-07d5-43f3-a9ab-ed1bef1776a7 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:56:33.171964 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975bb68d-07d5-43f3-a9ab-ed1bef1776a7 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:56:33.175881 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1307fb19-37fd-4c5b-b17a-3fa664a62e35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be63af25271b49b5903e8fe66a62b1d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:56:33.176507 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307fb19-37fd-4c5b-b17a-3fa664a62e35 service neutron] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:56:33.176787 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307fb19-37fd-4c5b-b17a-3fa664a62e35 service neutron] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:56:33.177061 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307fb19-37fd-4c5b-b17a-3fa664a62e35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:56:33.185668 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1307fb19-37fd-4c5b-b17a-3fa664a62e35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:56:33.187087 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1307fb19-37fd-4c5b-b17a-3fa664a62e35 service neutron] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:56:33.196839 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 486/961] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 11:56:33 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 11:56:37.631990 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37013bbb-f26d-4e59-aaae-038859dc6465 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:56:37.632503 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37013bbb-f26d-4e59-aaae-038859dc6465 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:56:37.632503 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37013bbb-f26d-4e59-aaae-038859dc6465 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:56:37.633880 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 476/962] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:56:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:56:37.639117 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f617f-3a80-40fd-ad6d-d77906e9e821 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:56:37.639540 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f617f-3a80-40fd-ad6d-d77906e9e821 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:56:37.639679 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f617f-3a80-40fd-ad6d-d77906e9e821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:56:37.657051 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-f02f617f-3a80-40fd-ad6d-d77906e9e821 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:56:37.658235 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-f02f617f-3a80-40fd-ad6d-d77906e9e821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:56:37.665960 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 487/963] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:56:37 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 11:56:37.706901 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37013bbb-f26d-4e59-aaae-038859dc6465 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:56:37.717597 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37013bbb-f26d-4e59-aaae-038859dc6465 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:56:37.721166 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e696e22-5104-4af9-9ec6-57aa44240452 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be63af25271b49b5903e8fe66a62b1d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:56:37.721802 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e696e22-5104-4af9-9ec6-57aa44240452 service neutron] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:56:37.722088 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e696e22-5104-4af9-9ec6-57aa44240452 service neutron] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:56:37.722365 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e696e22-5104-4af9-9ec6-57aa44240452 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:56:37.731321 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e696e22-5104-4af9-9ec6-57aa44240452 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:56:37.732778 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e696e22-5104-4af9-9ec6-57aa44240452 service neutron] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:56:37.742571 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 477/964] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 11:56:37 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 11:56:40.603276 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533f40a-6060-46c4-a2f1-509ac7ec3453 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:56:40.603829 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533f40a-6060-46c4-a2f1-509ac7ec3453 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:56:40.603925 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533f40a-6060-46c4-a2f1-509ac7ec3453 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:56:40.605206 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 488/965] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:56:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:56:40.610342 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3916f90f-5f85-43dd-a85b-7bf7ee9a02db None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:56:40.610770 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3916f90f-5f85-43dd-a85b-7bf7ee9a02db None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:56:40.610907 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3916f90f-5f85-43dd-a85b-7bf7ee9a02db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:56:40.628131 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-3916f90f-5f85-43dd-a85b-7bf7ee9a02db None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:56:40.629317 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-3916f90f-5f85-43dd-a85b-7bf7ee9a02db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:56:40.637012 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 478/966] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:56:40 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 11:56:40.676111 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b533f40a-6060-46c4-a2f1-509ac7ec3453 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:56:40.686582 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b533f40a-6060-46c4-a2f1-509ac7ec3453 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:56:40.690061 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c4a215-9d24-4bcd-b4f6-95a3bbb768d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be63af25271b49b5903e8fe66a62b1d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:56:40.690730 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4a215-9d24-4bcd-b4f6-95a3bbb768d0 service neutron] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:56:40.691012 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4a215-9d24-4bcd-b4f6-95a3bbb768d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:56:40.691285 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4a215-9d24-4bcd-b4f6-95a3bbb768d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:56:40.700038 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c4a215-9d24-4bcd-b4f6-95a3bbb768d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:56:40.701489 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c4a215-9d24-4bcd-b4f6-95a3bbb768d0 service neutron] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:56:40.711271 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 489/967] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 11:56:40 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 11:56:44.897847 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871b306-17fa-4e24-8284-5b78728787f0 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:56:44.898459 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871b306-17fa-4e24-8284-5b78728787f0 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:56:44.898459 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871b306-17fa-4e24-8284-5b78728787f0 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:56:44.899825 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 479/968] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:56:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:56:44.905383 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324ae31-2052-4022-9df8-3152ee051517 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:56:44.905864 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324ae31-2052-4022-9df8-3152ee051517 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:56:44.906001 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324ae31-2052-4022-9df8-3152ee051517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:56:44.912863 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=57 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:56:44.927460 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-b324ae31-2052-4022-9df8-3152ee051517 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:56:44.928867 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-b324ae31-2052-4022-9df8-3152ee051517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:56:44.936678 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 490/969] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:56:44 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 11:56:44.976795 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871b306-17fa-4e24-8284-5b78728787f0 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:56:44.987334 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871b306-17fa-4e24-8284-5b78728787f0 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:56:44.990799 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abfdd0c-f9f7-4b46-868f-b1b29fb0784d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be63af25271b49b5903e8fe66a62b1d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:56:44.991462 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abfdd0c-f9f7-4b46-868f-b1b29fb0784d service neutron] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:56:44.991749 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abfdd0c-f9f7-4b46-868f-b1b29fb0784d service neutron] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:56:44.992055 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abfdd0c-f9f7-4b46-868f-b1b29fb0784d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:56:45.000711 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abfdd0c-f9f7-4b46-868f-b1b29fb0784d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:56:45.002138 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abfdd0c-f9f7-4b46-868f-b1b29fb0784d service neutron] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:56:45.011297 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 480/970] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 11:56:44 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 11:56:50.514610 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a47d8-9396-47de-8029-641d074e7fc0 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:56:50.515482 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a47d8-9396-47de-8029-641d074e7fc0 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:56:50.515978 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a47d8-9396-47de-8029-641d074e7fc0 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:56:50.518020 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 491/971] 10.222.0.44 () {54 vars in 921 bytes} [Wed May 25 11:56:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:56:50.523624 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471999a-6d02-4641-86e3-bf2c4dd346e1 None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:56:50.524087 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471999a-6d02-4641-86e3-bf2c4dd346e1 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:56:50.524912 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471999a-6d02-4641-86e3-bf2c4dd346e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:56:50.566597 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-0471999a-6d02-4641-86e3-bf2c4dd346e1 None None] MFA Rules not processed for user `94f4a0c602a7495dbb36dd768cc55a47`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:56:50.568098 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-0471999a-6d02-4641-86e3-bf2c4dd346e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:56:50.652444 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 481/972] 10.222.0.44 () {58 vars in 1018 bytes} [Wed May 25 11:56:50 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 11:56:54.921234 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=2 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:56:54.982095 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd984df-8d71-4cd0-a26d-a8adca3313a3 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:56:54.982419 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd984df-8d71-4cd0-a26d-a8adca3313a3 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:56:54.982659 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd984df-8d71-4cd0-a26d-a8adca3313a3 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:56:54.984248 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 492/973] 10.222.0.44 () {54 vars in 921 bytes} [Wed May 25 11:56:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:56:54.990326 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0281d-158b-42dc-bc55-3d02c4bf1d4c None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:56:54.990807 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0281d-158b-42dc-bc55-3d02c4bf1d4c None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:56:54.990887 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0281d-158b-42dc-bc55-3d02c4bf1d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:56:55.009205 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-dde0281d-158b-42dc-bc55-3d02c4bf1d4c None None] MFA Rules not processed for user `94f4a0c602a7495dbb36dd768cc55a47`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:56:55.010644 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-dde0281d-158b-42dc-bc55-3d02c4bf1d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:56:55.020208 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 482/974] 10.222.0.44 () {58 vars in 1018 bytes} [Wed May 25 11:56:54 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 11:56:56.571158 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7290d-1c8b-46b4-a974-d3f589072899 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:56:56.571674 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7290d-1c8b-46b4-a974-d3f589072899 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:56:56.571674 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7290d-1c8b-46b4-a974-d3f589072899 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:56:56.573029 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 493/975] 10.222.0.44 () {54 vars in 921 bytes} [Wed May 25 11:56:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:56:56.577992 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e43436-4456-4960-9041-721b8e3c6c88 None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:56:56.578423 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e43436-4456-4960-9041-721b8e3c6c88 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:56:56.578552 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e43436-4456-4960-9041-721b8e3c6c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:56:56.596818 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-85e43436-4456-4960-9041-721b8e3c6c88 None None] MFA Rules not processed for user `94f4a0c602a7495dbb36dd768cc55a47`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:56:56.598011 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-85e43436-4456-4960-9041-721b8e3c6c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:56:56.606386 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 483/976] 10.222.0.44 () {58 vars in 1018 bytes} [Wed May 25 11:56:56 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 11:57:00.716019 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c3824-bdbb-4638-81a7-16bc7be2cd10 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:00.716638 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c3824-bdbb-4638-81a7-16bc7be2cd10 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:00.716638 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c3824-bdbb-4638-81a7-16bc7be2cd10 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:00.718071 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 494/977] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:57:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:57:00.723086 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cdf682-4659-4a6c-bf1e-951af87f7cbf None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:00.723881 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cdf682-4659-4a6c-bf1e-951af87f7cbf None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:00.724173 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cdf682-4659-4a6c-bf1e-951af87f7cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:00.730204 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=69 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:57:00.743357 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-c2cdf682-4659-4a6c-bf1e-951af87f7cbf None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:57:00.744781 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-c2cdf682-4659-4a6c-bf1e-951af87f7cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:57:00.753417 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 484/978] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:57:00 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 11:57:00.812112 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b57587-bdea-4e5a-a6c5-02a9f1913bac None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:00.812657 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b57587-bdea-4e5a-a6c5-02a9f1913bac None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:00.813147 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b57587-bdea-4e5a-a6c5-02a9f1913bac None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:00.815203 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 495/979] 10.222.0.44 () {54 vars in 961 bytes} [Wed May 25 11:57:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:57:00.822669 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ec02f-dd16-4013-b08f-9e65fd860759 None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:00.822959 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ec02f-dd16-4013-b08f-9e65fd860759 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:00.823420 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ec02f-dd16-4013-b08f-9e65fd860759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:00.866414 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-f40ec02f-dd16-4013-b08f-9e65fd860759 None None] MFA Rules not processed for user `d25d7a439361492d8d7ba018531a2e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:57:00.867732 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-f40ec02f-dd16-4013-b08f-9e65fd860759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:57:00.944150 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 485/980] 10.222.0.44 () {58 vars in 1058 bytes} [Wed May 25 11:57:00 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 11:57:00.952069 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b57587-bdea-4e5a-a6c5-02a9f1913bac None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:57:00.965254 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b57587-bdea-4e5a-a6c5-02a9f1913bac None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:57:00.970231 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b84eb-182d-4550-86e1-4e9f591e5866 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd25d7a439361492d8d7ba018531a2e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:57:00.970863 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b84eb-182d-4550-86e1-4e9f591e5866 service nova] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:00.971159 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b84eb-182d-4550-86e1-4e9f591e5866 service nova] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:00.971454 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b84eb-182d-4550-86e1-4e9f591e5866 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:00.979718 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0b84eb-182d-4550-86e1-4e9f591e5866 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:57:00.981306 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0b84eb-182d-4550-86e1-4e9f591e5866 service nova] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:57:00.991151 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 496/981] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 11:57:00 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 11:57:03.556185 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a6d91-36a8-4e86-9e56-d6184bef1974 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:03.556700 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a6d91-36a8-4e86-9e56-d6184bef1974 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:03.556790 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a6d91-36a8-4e86-9e56-d6184bef1974 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:03.558113 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 486/982] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:57:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:57:03.563438 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc08c2-a637-41e3-8885-c4c45fb79a60 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:03.563980 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc08c2-a637-41e3-8885-c4c45fb79a60 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:03.564095 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc08c2-a637-41e3-8885-c4c45fb79a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:03.581719 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-d0fc08c2-a637-41e3-8885-c4c45fb79a60 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:57:03.583126 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-d0fc08c2-a637-41e3-8885-c4c45fb79a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:57:03.591474 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 497/983] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:57:03 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 11:57:03.637250 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a6d91-36a8-4e86-9e56-d6184bef1974 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:57:03.651619 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a6d91-36a8-4e86-9e56-d6184bef1974 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:57:03.656617 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731b8e06-dfea-4460-9364-033fb1526df3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd25d7a439361492d8d7ba018531a2e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:57:03.657252 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b8e06-dfea-4460-9364-033fb1526df3 service nova] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:03.657541 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b8e06-dfea-4460-9364-033fb1526df3 service nova] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:03.657822 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b8e06-dfea-4460-9364-033fb1526df3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:03.666952 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731b8e06-dfea-4460-9364-033fb1526df3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:57:03.668579 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731b8e06-dfea-4460-9364-033fb1526df3 service nova] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:57:03.679588 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 487/984] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 11:57:03 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 11:57:06.340876 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d069fe-9249-47b5-bafc-d2a187806b5e None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:06.341383 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d069fe-9249-47b5-bafc-d2a187806b5e None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:06.341383 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d069fe-9249-47b5-bafc-d2a187806b5e None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:06.342671 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 498/985] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:57:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:57:06.348440 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28dedb1-6be7-46d1-b4e2-2956df701919 None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:06.348871 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28dedb1-6be7-46d1-b4e2-2956df701919 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:06.348967 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28dedb1-6be7-46d1-b4e2-2956df701919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:06.366961 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-b28dedb1-6be7-46d1-b4e2-2956df701919 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:57:06.368157 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-b28dedb1-6be7-46d1-b4e2-2956df701919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:57:06.376000 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 488/986] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:57:06 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 11:57:06.422682 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580944f-148d-486e-95a8-d0c2802eb506 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:06.422967 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580944f-148d-486e-95a8-d0c2802eb506 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:06.423244 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580944f-148d-486e-95a8-d0c2802eb506 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:06.425211 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 499/987] 10.222.0.44 () {54 vars in 961 bytes} [Wed May 25 11:57:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:57:06.430567 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0699d5c-08cb-4395-ac96-2239cfdbc867 None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:06.430855 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0699d5c-08cb-4395-ac96-2239cfdbc867 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:06.431133 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0699d5c-08cb-4395-ac96-2239cfdbc867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:06.449057 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-d0699d5c-08cb-4395-ac96-2239cfdbc867 None None] MFA Rules not processed for user `d25d7a439361492d8d7ba018531a2e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:57:06.450181 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-d0699d5c-08cb-4395-ac96-2239cfdbc867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:57:06.458626 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 489/988] 10.222.0.44 () {58 vars in 1058 bytes} [Wed May 25 11:57:06 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 11:57:06.466196 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9580944f-148d-486e-95a8-d0c2802eb506 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:57:06.480645 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9580944f-148d-486e-95a8-d0c2802eb506 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:57:06.487725 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557928ec-676c-4a44-8686-a8ce4a067318 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd25d7a439361492d8d7ba018531a2e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:57:06.488615 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557928ec-676c-4a44-8686-a8ce4a067318 service nova] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:06.488906 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557928ec-676c-4a44-8686-a8ce4a067318 service nova] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:06.489195 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557928ec-676c-4a44-8686-a8ce4a067318 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:06.497857 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557928ec-676c-4a44-8686-a8ce4a067318 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:57:06.499480 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557928ec-676c-4a44-8686-a8ce4a067318 service nova] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:57:06.515953 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 500/989] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 11:57:06 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 11:57:08.976006 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b617b-76bf-4653-a221-6234cf5f3e76 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:08.976965 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b617b-76bf-4653-a221-6234cf5f3e76 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:08.977464 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b617b-76bf-4653-a221-6234cf5f3e76 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:08.984630 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4481b-9ce8-412e-9c42-04167899498f None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:08.986113 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4481b-9ce8-412e-9c42-04167899498f None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:08.986644 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4481b-9ce8-412e-9c42-04167899498f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:08.989069 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 490/990] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:57:08 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:57:09.006020 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-24c4481b-9ce8-412e-9c42-04167899498f None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:57:09.007563 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-24c4481b-9ce8-412e-9c42-04167899498f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:57:09.033438 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 501/991] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:57:08 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 11:57:09.079454 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b617b-76bf-4653-a221-6234cf5f3e76 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:57:09.094965 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b617b-76bf-4653-a221-6234cf5f3e76 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:57:09.101259 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67a2b0a-09a8-44a9-93cf-455db9f3fe37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd25d7a439361492d8d7ba018531a2e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:57:09.102157 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a2b0a-09a8-44a9-93cf-455db9f3fe37 service nova] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:09.102666 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a2b0a-09a8-44a9-93cf-455db9f3fe37 service nova] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:09.103166 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a2b0a-09a8-44a9-93cf-455db9f3fe37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:09.113100 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67a2b0a-09a8-44a9-93cf-455db9f3fe37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:57:09.114973 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67a2b0a-09a8-44a9-93cf-455db9f3fe37 service nova] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:57:09.125310 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 491/992] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 11:57:09 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 11:57:10.769263 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baca7f9-9b00-496e-b08d-229dd383184a None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:10.769823 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baca7f9-9b00-496e-b08d-229dd383184a None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:10.769823 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baca7f9-9b00-496e-b08d-229dd383184a None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:10.771158 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 502/993] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:57:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:57:10.776382 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68bb879-074c-4dbd-8235-efa6f407719f None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:10.776779 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68bb879-074c-4dbd-8235-efa6f407719f None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:10.776947 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68bb879-074c-4dbd-8235-efa6f407719f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:10.795744 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-c68bb879-074c-4dbd-8235-efa6f407719f None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:57:10.797106 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-c68bb879-074c-4dbd-8235-efa6f407719f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:57:10.805426 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 492/994] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:57:10 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 11:57:11.118391 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a314c93-ccc3-4861-95f8-757983835336 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:11.118685 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a314c93-ccc3-4861-95f8-757983835336 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:11.118966 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a314c93-ccc3-4861-95f8-757983835336 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:11.120503 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 503/995] 10.222.0.44 () {54 vars in 963 bytes} [Wed May 25 11:57:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:57:11.125486 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b4356-efd3-4de0-90be-33b71befcbee None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:11.125783 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b4356-efd3-4de0-90be-33b71befcbee None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:11.126068 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b4356-efd3-4de0-90be-33b71befcbee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:11.173823 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-781b4356-efd3-4de0-90be-33b71befcbee None None] MFA Rules not processed for user `9c940de37d2d453c875d3ab6c077a331`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:57:11.176164 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-781b4356-efd3-4de0-90be-33b71befcbee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:57:11.242080 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 493/996] 10.222.0.44 () {58 vars in 1060 bytes} [Wed May 25 11:57:11 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 11:57:11.249597 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a314c93-ccc3-4861-95f8-757983835336 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:57:11.260978 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a314c93-ccc3-4861-95f8-757983835336 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:57:11.264701 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b8cadc-1393-4f16-848b-29ac946931cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c940de37d2d453c875d3ab6c077a331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:57:11.265452 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8cadc-1393-4f16-848b-29ac946931cb service cinder] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:11.265850 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8cadc-1393-4f16-848b-29ac946931cb service cinder] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:11.266243 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8cadc-1393-4f16-848b-29ac946931cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:11.276178 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b8cadc-1393-4f16-848b-29ac946931cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:57:11.277938 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b8cadc-1393-4f16-848b-29ac946931cb service cinder] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:57:11.288739 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 504/997] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 11:57:11 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 11:57:11.609241 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a007e9c-41c9-42a9-ba16-2ee8c8995a1f None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:11.609538 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a007e9c-41c9-42a9-ba16-2ee8c8995a1f None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:11.610004 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a007e9c-41c9-42a9-ba16-2ee8c8995a1f None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:11.611379 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 494/998] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:57:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 11:57:11.617200 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6239fe93-bd45-4b69-a312-c4aa6a42d3b1 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:11.617601 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6239fe93-bd45-4b69-a312-c4aa6a42d3b1 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:11.617986 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6239fe93-bd45-4b69-a312-c4aa6a42d3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:11.635908 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-6239fe93-bd45-4b69-a312-c4aa6a42d3b1 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:57:11.637324 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-6239fe93-bd45-4b69-a312-c4aa6a42d3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:57:11.645715 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 505/999] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:57:11 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 11:57:11.693169 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a007e9c-41c9-42a9-ba16-2ee8c8995a1f None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:57:11.706953 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a007e9c-41c9-42a9-ba16-2ee8c8995a1f None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:57:11.712295 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfac4fa-fc6c-4a3e-94a3-1e9f7b8f992a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd25d7a439361492d8d7ba018531a2e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:57:11.713054 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfac4fa-fc6c-4a3e-94a3-1e9f7b8f992a service nova] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:11.713488 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfac4fa-fc6c-4a3e-94a3-1e9f7b8f992a service nova] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:11.713879 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfac4fa-fc6c-4a3e-94a3-1e9f7b8f992a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:11.723296 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfac4fa-fc6c-4a3e-94a3-1e9f7b8f992a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:57:11.725070 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfac4fa-fc6c-4a3e-94a3-1e9f7b8f992a service nova] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:57:11.729295 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:57:11.743104 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 495/1000] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 11:57:11 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 11:57:14.095742 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd35426-00a8-4ce7-8fac-4eb10247bc64 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:14.096790 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd35426-00a8-4ce7-8fac-4eb10247bc64 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:14.096914 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd35426-00a8-4ce7-8fac-4eb10247bc64 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:14.101804 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 506/1001] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:57:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:57:14.104404 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0aa70-6a00-4486-9d74-d4dc31a51827 None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:14.104829 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0aa70-6a00-4486-9d74-d4dc31a51827 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:14.104956 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0aa70-6a00-4486-9d74-d4dc31a51827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:14.123302 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-11a0aa70-6a00-4486-9d74-d4dc31a51827 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:57:14.124580 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-11a0aa70-6a00-4486-9d74-d4dc31a51827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:57:14.132487 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 496/1002] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:57:14 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 11:57:14.187183 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd35426-00a8-4ce7-8fac-4eb10247bc64 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:57:14.200561 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd35426-00a8-4ce7-8fac-4eb10247bc64 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:57:14.206139 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833fd52d-7b8b-4fde-a982-8ff3ad4c13bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd25d7a439361492d8d7ba018531a2e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:57:14.206778 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833fd52d-7b8b-4fde-a982-8ff3ad4c13bf service nova] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:14.207068 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833fd52d-7b8b-4fde-a982-8ff3ad4c13bf service nova] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:14.207339 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833fd52d-7b8b-4fde-a982-8ff3ad4c13bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:14.215543 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833fd52d-7b8b-4fde-a982-8ff3ad4c13bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:57:14.217113 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833fd52d-7b8b-4fde-a982-8ff3ad4c13bf service nova] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:57:14.226292 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 507/1003] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 11:57:14 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 11:57:16.581634 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19966894-f51d-4ea1-b880-b641d0684ae8 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:16.582151 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19966894-f51d-4ea1-b880-b641d0684ae8 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:16.582151 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19966894-f51d-4ea1-b880-b641d0684ae8 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:16.583588 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 497/1004] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:57:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:57:16.588559 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62aee3d-91b2-4067-b35e-2e1ff396d713 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:16.588973 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62aee3d-91b2-4067-b35e-2e1ff396d713 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:16.589113 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62aee3d-91b2-4067-b35e-2e1ff396d713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:16.607173 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-d62aee3d-91b2-4067-b35e-2e1ff396d713 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:57:16.608372 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-d62aee3d-91b2-4067-b35e-2e1ff396d713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:57:16.616135 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 508/1005] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:57:16 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 11:57:16.660116 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19966894-f51d-4ea1-b880-b641d0684ae8 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:57:16.673341 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19966894-f51d-4ea1-b880-b641d0684ae8 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:57:16.678685 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a108cdf-b243-424e-9d54-ed295a85b0db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd25d7a439361492d8d7ba018531a2e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:57:16.679309 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a108cdf-b243-424e-9d54-ed295a85b0db service nova] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:16.679593 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a108cdf-b243-424e-9d54-ed295a85b0db service nova] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:16.679901 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a108cdf-b243-424e-9d54-ed295a85b0db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:16.687855 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a108cdf-b243-424e-9d54-ed295a85b0db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:57:16.689413 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a108cdf-b243-424e-9d54-ed295a85b0db service nova] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:57:16.699832 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 498/1006] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 11:57:16 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 11:57:19.031084 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea825cb-2642-4101-bbac-91b556d094b2 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:19.031655 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea825cb-2642-4101-bbac-91b556d094b2 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:19.031896 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea825cb-2642-4101-bbac-91b556d094b2 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:19.033459 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 509/1007] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:57:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:57:19.040226 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b111bb3-8142-4c75-bf44-b49dbd745798 None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:19.040760 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b111bb3-8142-4c75-bf44-b49dbd745798 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:19.040950 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b111bb3-8142-4c75-bf44-b49dbd745798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:19.061427 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-2b111bb3-8142-4c75-bf44-b49dbd745798 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:57:19.062734 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-2b111bb3-8142-4c75-bf44-b49dbd745798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:57:19.070882 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 499/1008] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:57:19 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 11:57:19.117644 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea825cb-2642-4101-bbac-91b556d094b2 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:57:19.131500 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea825cb-2642-4101-bbac-91b556d094b2 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:57:19.136622 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edeae17-ed06-4ba4-bdc9-9f6dd349321b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd25d7a439361492d8d7ba018531a2e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:57:19.137364 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edeae17-ed06-4ba4-bdc9-9f6dd349321b service nova] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:19.137762 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edeae17-ed06-4ba4-bdc9-9f6dd349321b service nova] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:19.138137 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edeae17-ed06-4ba4-bdc9-9f6dd349321b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:19.146761 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edeae17-ed06-4ba4-bdc9-9f6dd349321b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:57:19.148567 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edeae17-ed06-4ba4-bdc9-9f6dd349321b service nova] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:57:19.158203 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 510/1009] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 11:57:19 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 11:57:21.475524 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3b4ff-2582-4c88-88df-89425f300e4a None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:21.476194 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3b4ff-2582-4c88-88df-89425f300e4a None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:21.476194 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3b4ff-2582-4c88-88df-89425f300e4a None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:21.477412 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 500/1010] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:57:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:57:21.483200 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af31de-fd6b-4fe3-b705-db3d88a027b2 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:21.483645 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af31de-fd6b-4fe3-b705-db3d88a027b2 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:21.483937 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af31de-fd6b-4fe3-b705-db3d88a027b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:21.506358 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-f8af31de-fd6b-4fe3-b705-db3d88a027b2 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:57:21.508092 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-f8af31de-fd6b-4fe3-b705-db3d88a027b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:57:21.518943 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 511/1011] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:57:21 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 11:57:21.568094 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf3b4ff-2582-4c88-88df-89425f300e4a None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:57:21.584421 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf3b4ff-2582-4c88-88df-89425f300e4a None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:57:21.590406 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585bdad5-1452-45da-93bf-907950bc1f76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd25d7a439361492d8d7ba018531a2e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:57:21.591334 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585bdad5-1452-45da-93bf-907950bc1f76 service nova] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:21.591994 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585bdad5-1452-45da-93bf-907950bc1f76 service nova] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:21.592354 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585bdad5-1452-45da-93bf-907950bc1f76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:21.604124 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585bdad5-1452-45da-93bf-907950bc1f76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:57:21.606151 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585bdad5-1452-45da-93bf-907950bc1f76 service nova] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:57:21.618958 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 501/1012] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 11:57:21 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 11:57:24.484766 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19193d91-4948-43b5-8ac7-63ab368f036c None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:24.487594 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19193d91-4948-43b5-8ac7-63ab368f036c None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:24.487594 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19193d91-4948-43b5-8ac7-63ab368f036c None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:24.488284 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 512/1013] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:57:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:57:24.494728 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a1598-2989-4b61-a7c3-2d2c56114216 None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:24.495234 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a1598-2989-4b61-a7c3-2d2c56114216 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:24.495418 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a1598-2989-4b61-a7c3-2d2c56114216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:24.521430 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-5a4a1598-2989-4b61-a7c3-2d2c56114216 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:57:24.525305 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-5a4a1598-2989-4b61-a7c3-2d2c56114216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:57:24.538194 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 502/1014] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:57:24 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 11:57:24.602729 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19193d91-4948-43b5-8ac7-63ab368f036c None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:57:24.617504 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19193d91-4948-43b5-8ac7-63ab368f036c None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:57:24.622429 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5be3e-f4ef-4601-be02-a57ca4fcb148 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd25d7a439361492d8d7ba018531a2e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:57:24.623092 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5be3e-f4ef-4601-be02-a57ca4fcb148 service nova] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:24.625571 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5be3e-f4ef-4601-be02-a57ca4fcb148 service nova] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:24.625571 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5be3e-f4ef-4601-be02-a57ca4fcb148 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:24.633964 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b5be3e-f4ef-4601-be02-a57ca4fcb148 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:57:24.635708 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b5be3e-f4ef-4601-be02-a57ca4fcb148 service nova] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:57:24.646912 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 513/1015] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 11:57:24 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 11:57:27.446791 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b3741-40a3-4bc9-9597-40ab149973eb None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:27.447384 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b3741-40a3-4bc9-9597-40ab149973eb None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:27.447384 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b3741-40a3-4bc9-9597-40ab149973eb None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:27.448688 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 503/1016] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:57:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:57:27.453915 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7d6d0-5473-4f5a-a26e-7211580ea090 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:27.454388 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7d6d0-5473-4f5a-a26e-7211580ea090 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:27.454493 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7d6d0-5473-4f5a-a26e-7211580ea090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:27.461121 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=52 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:57:27.473797 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-03f7d6d0-5473-4f5a-a26e-7211580ea090 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:57:27.474981 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-03f7d6d0-5473-4f5a-a26e-7211580ea090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:57:27.482727 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 514/1017] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:57:27 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 11:57:27.519713 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a29c35-cde3-4519-8164-d8694dd6d4e6 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:27.520063 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a29c35-cde3-4519-8164-d8694dd6d4e6 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:27.520346 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a29c35-cde3-4519-8164-d8694dd6d4e6 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:27.521705 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 504/1018] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:57:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:57:27.527784 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a13744-eb2c-4393-8979-3d141f856486 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:27.528099 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a13744-eb2c-4393-8979-3d141f856486 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:27.528380 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a13744-eb2c-4393-8979-3d141f856486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:27.530741 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a29c35-cde3-4519-8164-d8694dd6d4e6 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:57:27.544958 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a29c35-cde3-4519-8164-d8694dd6d4e6 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:57:27.546465 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-99a13744-eb2c-4393-8979-3d141f856486 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:57:27.547656 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-99a13744-eb2c-4393-8979-3d141f856486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:57:27.549974 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12567c9-3498-4f96-8398-ca819c6c6c12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd25d7a439361492d8d7ba018531a2e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:57:27.550607 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12567c9-3498-4f96-8398-ca819c6c6c12 service nova] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:27.550887 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12567c9-3498-4f96-8398-ca819c6c6c12 service nova] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:27.551169 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12567c9-3498-4f96-8398-ca819c6c6c12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:27.555465 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 515/1019] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:57:27 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 11:57:27.560858 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12567c9-3498-4f96-8398-ca819c6c6c12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:57:27.562455 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12567c9-3498-4f96-8398-ca819c6c6c12 service nova] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:57:27.572241 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 505/1020] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 11:57:27 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 11:57:27.614985 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb910b6-97bd-495c-bab4-ddf1b9f5de31 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:27.615281 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb910b6-97bd-495c-bab4-ddf1b9f5de31 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:27.615565 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb910b6-97bd-495c-bab4-ddf1b9f5de31 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:27.616966 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 516/1021] 10.222.0.44 () {54 vars in 962 bytes} [Wed May 25 11:57:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:57:27.622213 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e88b98-24aa-46c8-a665-5d1a3ccf426b None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:27.622622 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e88b98-24aa-46c8-a665-5d1a3ccf426b None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:27.623025 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e88b98-24aa-46c8-a665-5d1a3ccf426b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:27.666200 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-a9e88b98-24aa-46c8-a665-5d1a3ccf426b None None] MFA Rules not processed for user `bda1409f24a24f51b42043933e30a560`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:57:27.667470 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-a9e88b98-24aa-46c8-a665-5d1a3ccf426b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:57:27.733466 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 506/1022] 10.222.0.44 () {58 vars in 1059 bytes} [Wed May 25 11:57:27 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 11:57:27.741286 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb910b6-97bd-495c-bab4-ddf1b9f5de31 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:57:27.752157 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb910b6-97bd-495c-bab4-ddf1b9f5de31 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:57:27.756322 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54053654-7a64-4cfe-9755-889e5ab3fa10 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bda1409f24a24f51b42043933e30a560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:57:27.756975 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54053654-7a64-4cfe-9755-889e5ab3fa10 service glance] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:27.757254 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54053654-7a64-4cfe-9755-889e5ab3fa10 service glance] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:27.757524 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54053654-7a64-4cfe-9755-889e5ab3fa10 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:27.767290 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54053654-7a64-4cfe-9755-889e5ab3fa10 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:57:27.769157 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54053654-7a64-4cfe-9755-889e5ab3fa10 service glance] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:57:27.779917 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 517/1023] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 11:57:27 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 11:57:29.895158 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e640e4-a85e-45d7-9b68-21a2f04c5aae None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:29.895158 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e640e4-a85e-45d7-9b68-21a2f04c5aae None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:29.895158 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e640e4-a85e-45d7-9b68-21a2f04c5aae None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:29.895158 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 507/1024] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:57:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:57:29.896192 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9ddaf-c136-4e0a-ba93-04e417c4be1e None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:29.896192 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9ddaf-c136-4e0a-ba93-04e417c4be1e None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:29.896192 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9ddaf-c136-4e0a-ba93-04e417c4be1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:29.922700 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-cda9ddaf-c136-4e0a-ba93-04e417c4be1e None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:57:29.923982 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-cda9ddaf-c136-4e0a-ba93-04e417c4be1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:57:29.932534 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 518/1025] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:57:29 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 11:57:29.979299 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e640e4-a85e-45d7-9b68-21a2f04c5aae None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:57:29.994775 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e640e4-a85e-45d7-9b68-21a2f04c5aae None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:57:29.999636 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14130501-dd77-4c3f-bd13-5e294e7f8d4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd25d7a439361492d8d7ba018531a2e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:57:30.000422 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14130501-dd77-4c3f-bd13-5e294e7f8d4e service nova] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:30.000704 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14130501-dd77-4c3f-bd13-5e294e7f8d4e service nova] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:30.000974 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14130501-dd77-4c3f-bd13-5e294e7f8d4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:30.010355 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14130501-dd77-4c3f-bd13-5e294e7f8d4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:57:30.011996 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14130501-dd77-4c3f-bd13-5e294e7f8d4e service nova] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:57:30.022009 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 508/1026] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 11:57:29 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 11:57:39.916215 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=14 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:57:40.017455 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=67 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:57:43.131012 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bbfa15-1ab4-465e-baf3-988fcdf84f7c None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:43.131738 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bbfa15-1ab4-465e-baf3-988fcdf84f7c None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:43.131738 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bbfa15-1ab4-465e-baf3-988fcdf84f7c None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:43.132971 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 519/1027] 10.222.0.44 () {54 vars in 918 bytes} [Wed May 25 11:57:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:57:43.138110 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f7d4ef-2fce-4744-83fd-dbb4d6fa4dd0 None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:43.138601 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f7d4ef-2fce-4744-83fd-dbb4d6fa4dd0 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:43.138706 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f7d4ef-2fce-4744-83fd-dbb4d6fa4dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:43.157070 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-d0f7d4ef-2fce-4744-83fd-dbb4d6fa4dd0 None None] MFA Rules not processed for user `94f4a0c602a7495dbb36dd768cc55a47`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:57:43.163000 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-d0f7d4ef-2fce-4744-83fd-dbb4d6fa4dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:57:43.171905 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 509/1028] 10.222.0.44 () {58 vars in 1015 bytes} [Wed May 25 11:57:43 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 11:57:43.185706 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ef3e4-bc39-4a6f-a997-71e2bda12b27 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:43.185994 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ef3e4-bc39-4a6f-a997-71e2bda12b27 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:43.186272 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ef3e4-bc39-4a6f-a997-71e2bda12b27 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:43.187600 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 520/1029] 10.222.0.44 () {54 vars in 918 bytes} [Wed May 25 11:57:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:57:43.192751 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c9a23-9892-44b4-a196-b8ea8d621c4b None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:43.193032 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c9a23-9892-44b4-a196-b8ea8d621c4b None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:43.193307 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c9a23-9892-44b4-a196-b8ea8d621c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:43.211366 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-b17c9a23-9892-44b4-a196-b8ea8d621c4b None None] MFA Rules not processed for user `d25d7a439361492d8d7ba018531a2e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:57:43.212567 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-b17c9a23-9892-44b4-a196-b8ea8d621c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:57:43.220917 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 510/1030] 10.222.0.44 () {58 vars in 1015 bytes} [Wed May 25 11:57:43 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 11:57:45.951484 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948cbdcd-1eb3-4074-810b-6bd94afed2f8 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:45.952119 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948cbdcd-1eb3-4074-810b-6bd94afed2f8 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:45.952119 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948cbdcd-1eb3-4074-810b-6bd94afed2f8 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:45.953460 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 521/1031] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 11:57:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:57:45.959151 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10048d45-76c7-4de7-b523-4ea565394350 None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:45.959602 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10048d45-76c7-4de7-b523-4ea565394350 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:45.959700 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10048d45-76c7-4de7-b523-4ea565394350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:45.977529 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-10048d45-76c7-4de7-b523-4ea565394350 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:57:45.978698 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-10048d45-76c7-4de7-b523-4ea565394350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:57:45.986345 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 511/1032] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 11:57:45 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 11:57:46.030431 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948cbdcd-1eb3-4074-810b-6bd94afed2f8 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:57:46.044969 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948cbdcd-1eb3-4074-810b-6bd94afed2f8 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:57:46.049841 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0abe2-8f7d-4cd9-9191-fcea4df9179a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd25d7a439361492d8d7ba018531a2e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:57:46.050463 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0abe2-8f7d-4cd9-9191-fcea4df9179a service nova] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:46.050740 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0abe2-8f7d-4cd9-9191-fcea4df9179a service nova] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:46.051009 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0abe2-8f7d-4cd9-9191-fcea4df9179a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:46.058987 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b0abe2-8f7d-4cd9-9191-fcea4df9179a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:57:46.060614 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b0abe2-8f7d-4cd9-9191-fcea4df9179a service nova] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:57:46.069850 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 522/1033] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 11:57:46 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 11:57:47.061789 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad59e2e2-c2f8-4bb8-a6c6-cef327c3568e None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:47.062361 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad59e2e2-c2f8-4bb8-a6c6-cef327c3568e None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:47.062361 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad59e2e2-c2f8-4bb8-a6c6-cef327c3568e None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:47.063726 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 512/1034] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 11:57:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:57:47.068571 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da75110-1950-4773-8cd8-897b475f2c38 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:47.068972 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da75110-1950-4773-8cd8-897b475f2c38 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:47.069126 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da75110-1950-4773-8cd8-897b475f2c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:47.086702 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-8da75110-1950-4773-8cd8-897b475f2c38 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:57:47.087914 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-8da75110-1950-4773-8cd8-897b475f2c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:57:47.096208 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 523/1035] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 11:57:47 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 11:57:47.299603 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad59e2e2-c2f8-4bb8-a6c6-cef327c3568e None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:57:47.312768 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad59e2e2-c2f8-4bb8-a6c6-cef327c3568e None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:57:47.317532 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47559168-1f0d-4554-9602-f6c345b2c458 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd25d7a439361492d8d7ba018531a2e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:57:47.318163 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47559168-1f0d-4554-9602-f6c345b2c458 service nova] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:47.318445 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47559168-1f0d-4554-9602-f6c345b2c458 service nova] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:47.318723 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47559168-1f0d-4554-9602-f6c345b2c458 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:47.326608 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47559168-1f0d-4554-9602-f6c345b2c458 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:57:47.328232 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47559168-1f0d-4554-9602-f6c345b2c458 service nova] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:57:47.337837 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 513/1036] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 11:57:47 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 11:57:48.293267 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb218569-cb93-4f29-ad63-c1ed59041f55 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:48.293975 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb218569-cb93-4f29-ad63-c1ed59041f55 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:48.293975 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb218569-cb93-4f29-ad63-c1ed59041f55 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:48.295185 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 524/1037] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 11:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:57:48.300835 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ba64e-9ab8-4011-82a7-b96a525ecb08 None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:48.301300 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ba64e-9ab8-4011-82a7-b96a525ecb08 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:48.301404 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ba64e-9ab8-4011-82a7-b96a525ecb08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:48.319514 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-4a0ba64e-9ab8-4011-82a7-b96a525ecb08 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:57:48.320745 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-4a0ba64e-9ab8-4011-82a7-b96a525ecb08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:57:48.328527 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 514/1038] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 11:57:48 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 11:57:48.482989 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb218569-cb93-4f29-ad63-c1ed59041f55 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:57:48.498748 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb218569-cb93-4f29-ad63-c1ed59041f55 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:57:48.506082 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d79936-97dc-4d75-a493-ac4ec1c57f81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd25d7a439361492d8d7ba018531a2e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:57:48.506754 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d79936-97dc-4d75-a493-ac4ec1c57f81 service nova] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:48.508771 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d79936-97dc-4d75-a493-ac4ec1c57f81 service nova] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:48.508771 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d79936-97dc-4d75-a493-ac4ec1c57f81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:48.516561 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d79936-97dc-4d75-a493-ac4ec1c57f81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:57:48.518533 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d79936-97dc-4d75-a493-ac4ec1c57f81 service nova] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:57:48.528217 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 525/1039] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 11:57:48 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 11:57:49.453150 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff2e55-00ff-415d-a866-871f6d76e797 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:49.453624 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff2e55-00ff-415d-a866-871f6d76e797 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:49.453624 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff2e55-00ff-415d-a866-871f6d76e797 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:49.455019 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 515/1040] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 11:57:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:57:49.460361 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc3df29-32d2-4f49-a859-6168f60cfe6f None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:49.460773 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc3df29-32d2-4f49-a859-6168f60cfe6f None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:49.460917 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc3df29-32d2-4f49-a859-6168f60cfe6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:49.478770 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-3dc3df29-32d2-4f49-a859-6168f60cfe6f None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:57:49.480013 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-3dc3df29-32d2-4f49-a859-6168f60cfe6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:57:49.490536 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 526/1041] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 11:57:49 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 11:57:49.646581 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff2e55-00ff-415d-a866-871f6d76e797 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:57:49.659841 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff2e55-00ff-415d-a866-871f6d76e797 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:57:49.664773 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f823691d-733a-4531-831c-4b3c4d11bdc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd25d7a439361492d8d7ba018531a2e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:57:49.665434 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823691d-733a-4531-831c-4b3c4d11bdc6 service nova] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:49.665721 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823691d-733a-4531-831c-4b3c4d11bdc6 service nova] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:49.665997 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823691d-733a-4531-831c-4b3c4d11bdc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:49.674424 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f823691d-733a-4531-831c-4b3c4d11bdc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:57:49.676080 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f823691d-733a-4531-831c-4b3c4d11bdc6 service nova] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:57:49.685342 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 516/1042] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 11:57:49 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 11:57:50.586787 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5d030-9059-488c-ba66-31ceb9fcc909 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:50.587318 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5d030-9059-488c-ba66-31ceb9fcc909 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:50.587318 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5d030-9059-488c-ba66-31ceb9fcc909 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:50.588685 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 527/1043] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 11:57:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:57:50.593465 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daac982-5706-48cf-9ede-12e3f044147e None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:50.593892 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daac982-5706-48cf-9ede-12e3f044147e None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:50.594040 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daac982-5706-48cf-9ede-12e3f044147e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:50.612343 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-6daac982-5706-48cf-9ede-12e3f044147e None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:57:50.613533 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-6daac982-5706-48cf-9ede-12e3f044147e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:57:50.621303 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 517/1044] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 11:57:50 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 11:57:50.772314 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e5d030-9059-488c-ba66-31ceb9fcc909 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:57:50.785423 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e5d030-9059-488c-ba66-31ceb9fcc909 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:57:50.790263 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d9468e-99e3-46d9-971c-e3c5a8a8c447 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd25d7a439361492d8d7ba018531a2e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:57:50.790880 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9468e-99e3-46d9-971c-e3c5a8a8c447 service nova] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:50.791161 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9468e-99e3-46d9-971c-e3c5a8a8c447 service nova] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:50.791432 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9468e-99e3-46d9-971c-e3c5a8a8c447 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:50.799519 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d9468e-99e3-46d9-971c-e3c5a8a8c447 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:57:50.801127 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d9468e-99e3-46d9-971c-e3c5a8a8c447 service nova] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:57:50.810274 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 528/1045] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 11:57:50 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 11:57:51.655519 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789121c1-4f38-48d4-b260-78d76322b57b None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:51.656076 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789121c1-4f38-48d4-b260-78d76322b57b None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:51.656076 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789121c1-4f38-48d4-b260-78d76322b57b None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:51.657443 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 518/1046] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 11:57:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:57:51.662816 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d1f22-7989-4973-a3ad-3838e6b7c710 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:51.663224 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d1f22-7989-4973-a3ad-3838e6b7c710 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:51.663373 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d1f22-7989-4973-a3ad-3838e6b7c710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:51.681292 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-c01d1f22-7989-4973-a3ad-3838e6b7c710 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:57:51.682638 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-c01d1f22-7989-4973-a3ad-3838e6b7c710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:57:51.690632 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 529/1047] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 11:57:51 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 11:57:51.843955 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789121c1-4f38-48d4-b260-78d76322b57b None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:57:51.857838 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789121c1-4f38-48d4-b260-78d76322b57b None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:57:51.862804 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b4c60-0814-4ecb-aeb4-89012488d91d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd25d7a439361492d8d7ba018531a2e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:57:51.863432 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b4c60-0814-4ecb-aeb4-89012488d91d service nova] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:51.863717 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b4c60-0814-4ecb-aeb4-89012488d91d service nova] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:51.864029 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b4c60-0814-4ecb-aeb4-89012488d91d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:51.872011 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60b4c60-0814-4ecb-aeb4-89012488d91d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:57:51.873577 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60b4c60-0814-4ecb-aeb4-89012488d91d service nova] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:57:51.882796 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 519/1048] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 11:57:51 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 11:57:52.740394 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a94c7-802e-4d3b-bc35-2abd3cd712f7 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:52.740933 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a94c7-802e-4d3b-bc35-2abd3cd712f7 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:52.740933 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a94c7-802e-4d3b-bc35-2abd3cd712f7 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:52.742302 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 530/1049] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 11:57:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:57:52.747128 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0ed49-35cd-4929-a1f0-1d218935d62f None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:52.747561 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0ed49-35cd-4929-a1f0-1d218935d62f None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:52.747689 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0ed49-35cd-4929-a1f0-1d218935d62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:52.765805 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-cad0ed49-35cd-4929-a1f0-1d218935d62f None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:57:52.766977 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-cad0ed49-35cd-4929-a1f0-1d218935d62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:57:52.775008 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 520/1050] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 11:57:52 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 11:57:52.928090 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a94c7-802e-4d3b-bc35-2abd3cd712f7 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:57:52.941939 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a94c7-802e-4d3b-bc35-2abd3cd712f7 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:57:52.946804 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b22f8-9161-4344-b971-9c2446b5f0ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd25d7a439361492d8d7ba018531a2e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:57:52.947427 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b22f8-9161-4344-b971-9c2446b5f0ef service nova] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:52.947708 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b22f8-9161-4344-b971-9c2446b5f0ef service nova] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:52.948014 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b22f8-9161-4344-b971-9c2446b5f0ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:52.955851 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b22f8-9161-4344-b971-9c2446b5f0ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:57:52.957417 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b22f8-9161-4344-b971-9c2446b5f0ef service nova] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:57:52.966446 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 531/1051] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 11:57:52 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 11:57:53.815653 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f243e96-b4b7-4f89-a57a-69e838875fe5 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:53.816253 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f243e96-b4b7-4f89-a57a-69e838875fe5 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:53.816253 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f243e96-b4b7-4f89-a57a-69e838875fe5 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:53.817605 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 521/1052] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 11:57:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:57:53.822370 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c963387-3413-40ad-8753-e298189acb5a None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:53.822811 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c963387-3413-40ad-8753-e298189acb5a None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:53.822937 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c963387-3413-40ad-8753-e298189acb5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:53.840483 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-0c963387-3413-40ad-8753-e298189acb5a None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:57:53.841668 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-0c963387-3413-40ad-8753-e298189acb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:57:53.849983 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 532/1053] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 11:57:53 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 11:57:54.006621 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f243e96-b4b7-4f89-a57a-69e838875fe5 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:57:54.020632 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f243e96-b4b7-4f89-a57a-69e838875fe5 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:57:54.025453 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5774874-210a-44b9-8817-15ce2bc869ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd25d7a439361492d8d7ba018531a2e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:57:54.026086 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5774874-210a-44b9-8817-15ce2bc869ac service nova] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:54.026374 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5774874-210a-44b9-8817-15ce2bc869ac service nova] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:54.026654 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5774874-210a-44b9-8817-15ce2bc869ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:54.035199 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5774874-210a-44b9-8817-15ce2bc869ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:57:54.036802 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5774874-210a-44b9-8817-15ce2bc869ac service nova] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:57:54.045954 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 522/1054] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 11:57:54 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 11:57:54.902298 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f72b988-07d6-4fee-8ca8-b61d28a4253e None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:54.902843 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f72b988-07d6-4fee-8ca8-b61d28a4253e None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:54.902843 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f72b988-07d6-4fee-8ca8-b61d28a4253e None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:54.904262 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 533/1055] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 11:57:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:57:54.909972 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7270a43-8466-49de-970a-1a065f2763e0 None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:54.910416 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7270a43-8466-49de-970a-1a065f2763e0 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:54.910663 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7270a43-8466-49de-970a-1a065f2763e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:54.928829 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-c7270a43-8466-49de-970a-1a065f2763e0 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:57:54.930014 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-c7270a43-8466-49de-970a-1a065f2763e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:57:54.937666 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 523/1056] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 11:57:54 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 11:57:55.090834 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f72b988-07d6-4fee-8ca8-b61d28a4253e None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:57:55.103949 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f72b988-07d6-4fee-8ca8-b61d28a4253e None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:57:55.108786 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd39fb6e-bf67-461c-a41d-8be661ef11c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd25d7a439361492d8d7ba018531a2e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:57:55.109411 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd39fb6e-bf67-461c-a41d-8be661ef11c5 service nova] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:55.109696 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd39fb6e-bf67-461c-a41d-8be661ef11c5 service nova] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:55.109974 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd39fb6e-bf67-461c-a41d-8be661ef11c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:55.118420 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd39fb6e-bf67-461c-a41d-8be661ef11c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:57:55.120026 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd39fb6e-bf67-461c-a41d-8be661ef11c5 service nova] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:57:55.129815 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 534/1057] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 11:57:55 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 11:57:57.247635 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8ea63-810d-4aef-a56e-82f52d9cf152 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:57.248192 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8ea63-810d-4aef-a56e-82f52d9cf152 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:57.248316 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8ea63-810d-4aef-a56e-82f52d9cf152 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:57.249870 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 524/1058] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 11:57:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:57:57.255662 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afeb9c4-27c2-444d-955a-49e012a43151 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:57.256117 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afeb9c4-27c2-444d-955a-49e012a43151 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:57.256257 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afeb9c4-27c2-444d-955a-49e012a43151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:57.273711 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-6afeb9c4-27c2-444d-955a-49e012a43151 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:57:57.274921 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-6afeb9c4-27c2-444d-955a-49e012a43151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:57:57.282629 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 535/1059] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 11:57:57 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 11:57:57.321993 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef8ea63-810d-4aef-a56e-82f52d9cf152 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:57:57.332300 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef8ea63-810d-4aef-a56e-82f52d9cf152 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:57:57.335677 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f02726-a986-4c3a-a4e9-e2a8b83e545f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be63af25271b49b5903e8fe66a62b1d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:57:57.336334 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f02726-a986-4c3a-a4e9-e2a8b83e545f service neutron] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:57.336614 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f02726-a986-4c3a-a4e9-e2a8b83e545f service neutron] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:57.336887 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f02726-a986-4c3a-a4e9-e2a8b83e545f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:57.345372 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f02726-a986-4c3a-a4e9-e2a8b83e545f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:57:57.346786 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f02726-a986-4c3a-a4e9-e2a8b83e545f service neutron] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:57:57.355945 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 525/1060] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 11:57:57 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 11:57:59.771520 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cfb259-e965-4af6-9440-7432b957ebc8 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:59.772118 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cfb259-e965-4af6-9440-7432b957ebc8 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:59.772118 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cfb259-e965-4af6-9440-7432b957ebc8 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:59.773467 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 536/1061] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 11:57:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:57:59.778683 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5249c-8fdd-4b26-a0ff-bbf94bca02aa None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:59.779067 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5249c-8fdd-4b26-a0ff-bbf94bca02aa None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:59.779241 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5249c-8fdd-4b26-a0ff-bbf94bca02aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:59.796816 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-d9b5249c-8fdd-4b26-a0ff-bbf94bca02aa None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:57:59.797987 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-d9b5249c-8fdd-4b26-a0ff-bbf94bca02aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:57:59.806079 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 526/1062] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 11:57:59 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 11:57:59.845415 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cfb259-e965-4af6-9440-7432b957ebc8 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:57:59.856518 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cfb259-e965-4af6-9440-7432b957ebc8 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:57:59.860009 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcbc753-cdd1-40ac-b9d6-3f5c51d288b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be63af25271b49b5903e8fe66a62b1d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:57:59.860635 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbc753-cdd1-40ac-b9d6-3f5c51d288b7 service neutron] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:57:59.860922 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbc753-cdd1-40ac-b9d6-3f5c51d288b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:57:59.861862 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbc753-cdd1-40ac-b9d6-3f5c51d288b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:57:59.870531 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcbc753-cdd1-40ac-b9d6-3f5c51d288b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:57:59.871986 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcbc753-cdd1-40ac-b9d6-3f5c51d288b7 service neutron] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:57:59.881137 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 537/1063] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 11:57:59 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 11:58:02.448632 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40868e26-e099-4f6c-84fd-b93219f9e4d0 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:58:02.449189 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40868e26-e099-4f6c-84fd-b93219f9e4d0 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:58:02.449189 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40868e26-e099-4f6c-84fd-b93219f9e4d0 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:58:02.450590 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 527/1064] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 11:58:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:58:02.455819 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f7159-1b78-4ad2-89ec-a2d19216e2e1 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:58:02.456266 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f7159-1b78-4ad2-89ec-a2d19216e2e1 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:58:02.456375 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f7159-1b78-4ad2-89ec-a2d19216e2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:58:02.473722 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-400f7159-1b78-4ad2-89ec-a2d19216e2e1 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:58:02.474897 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-400f7159-1b78-4ad2-89ec-a2d19216e2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:58:02.482453 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 538/1065] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 11:58:02 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 11:58:02.522329 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40868e26-e099-4f6c-84fd-b93219f9e4d0 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:58:02.532888 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40868e26-e099-4f6c-84fd-b93219f9e4d0 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:58:02.536380 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd9ba1d-1fb4-4dd5-8a37-a8465b646371 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be63af25271b49b5903e8fe66a62b1d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:58:02.537015 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9ba1d-1fb4-4dd5-8a37-a8465b646371 service neutron] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:58:02.537302 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9ba1d-1fb4-4dd5-8a37-a8465b646371 service neutron] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:58:02.537582 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9ba1d-1fb4-4dd5-8a37-a8465b646371 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:58:02.546269 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd9ba1d-1fb4-4dd5-8a37-a8465b646371 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:58:02.547706 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd9ba1d-1fb4-4dd5-8a37-a8465b646371 service neutron] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:58:02.557387 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 528/1066] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 11:58:02 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 11:58:04.921851 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af8cba-6a21-4bbd-967c-58b477d42b74 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:58:04.922405 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af8cba-6a21-4bbd-967c-58b477d42b74 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:58:04.922405 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af8cba-6a21-4bbd-967c-58b477d42b74 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:58:04.923814 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 539/1067] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 11:58:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:58:04.929078 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d30dad8-65bf-4d83-b717-b310eadacf4c None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:58:04.929531 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d30dad8-65bf-4d83-b717-b310eadacf4c None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:58:04.929632 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d30dad8-65bf-4d83-b717-b310eadacf4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:58:04.947462 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-5d30dad8-65bf-4d83-b717-b310eadacf4c None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:58:04.948687 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-5d30dad8-65bf-4d83-b717-b310eadacf4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:58:04.956942 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 529/1068] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 11:58:04 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 11:58:04.995637 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af8cba-6a21-4bbd-967c-58b477d42b74 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:58:05.006739 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af8cba-6a21-4bbd-967c-58b477d42b74 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:58:05.010263 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f0f820-a7f3-4123-8779-36316aab266a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be63af25271b49b5903e8fe66a62b1d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:58:05.010892 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0f820-a7f3-4123-8779-36316aab266a service neutron] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:58:05.011177 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0f820-a7f3-4123-8779-36316aab266a service neutron] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:58:05.011456 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0f820-a7f3-4123-8779-36316aab266a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:58:05.021054 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f0f820-a7f3-4123-8779-36316aab266a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:58:05.022485 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f0f820-a7f3-4123-8779-36316aab266a service neutron] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:58:05.031706 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 540/1069] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 11:58:04 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 11:58:07.502181 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7710758-e17f-49f7-9bcc-f86475e8a384 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:58:07.502701 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7710758-e17f-49f7-9bcc-f86475e8a384 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:58:07.502701 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7710758-e17f-49f7-9bcc-f86475e8a384 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:58:07.504156 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 530/1070] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 11:58:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:58:07.509390 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691c3b2-e92e-433c-b9ca-de3a36206083 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:58:07.509798 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691c3b2-e92e-433c-b9ca-de3a36206083 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:58:07.509955 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691c3b2-e92e-433c-b9ca-de3a36206083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:58:07.528011 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-3691c3b2-e92e-433c-b9ca-de3a36206083 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:58:07.529194 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-3691c3b2-e92e-433c-b9ca-de3a36206083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:58:07.537478 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 541/1071] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 11:58:07 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 11:58:07.575718 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7710758-e17f-49f7-9bcc-f86475e8a384 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:58:07.586890 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7710758-e17f-49f7-9bcc-f86475e8a384 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:58:07.590383 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9256253a-9b65-40c2-b881-d99f78123244 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be63af25271b49b5903e8fe66a62b1d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:58:07.591020 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256253a-9b65-40c2-b881-d99f78123244 service neutron] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:58:07.591303 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256253a-9b65-40c2-b881-d99f78123244 service neutron] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:58:07.591580 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256253a-9b65-40c2-b881-d99f78123244 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:58:07.601226 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9256253a-9b65-40c2-b881-d99f78123244 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:58:07.602665 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9256253a-9b65-40c2-b881-d99f78123244 service neutron] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:58:07.612133 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 531/1072] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 11:58:07 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 11:58:09.925926 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8e357-ad4b-4bcd-a7cf-d6c4fa129525 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:58:09.926472 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8e357-ad4b-4bcd-a7cf-d6c4fa129525 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:58:09.926472 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8e357-ad4b-4bcd-a7cf-d6c4fa129525 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:58:09.927838 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 542/1073] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 11:58:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:58:09.933217 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ac1be-2b07-488f-b153-19f87a0946b1 None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:58:09.933632 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ac1be-2b07-488f-b153-19f87a0946b1 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:58:09.933786 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ac1be-2b07-488f-b153-19f87a0946b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:58:09.951948 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-ae7ac1be-2b07-488f-b153-19f87a0946b1 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:58:09.953130 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-ae7ac1be-2b07-488f-b153-19f87a0946b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:58:09.960874 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 532/1074] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 11:58:09 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 11:58:09.999851 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8e357-ad4b-4bcd-a7cf-d6c4fa129525 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:58:10.005746 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=64 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:58:10.012191 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8e357-ad4b-4bcd-a7cf-d6c4fa129525 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:58:10.015620 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e41f2d-cb31-4a1f-aaaf-dd49352b4bf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be63af25271b49b5903e8fe66a62b1d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:58:10.016272 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e41f2d-cb31-4a1f-aaaf-dd49352b4bf9 service neutron] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:58:10.016554 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e41f2d-cb31-4a1f-aaaf-dd49352b4bf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:58:10.016827 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e41f2d-cb31-4a1f-aaaf-dd49352b4bf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:58:10.025727 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e41f2d-cb31-4a1f-aaaf-dd49352b4bf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:58:10.027156 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e41f2d-cb31-4a1f-aaaf-dd49352b4bf9 service neutron] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:58:10.036264 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 543/1075] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 11:58:09 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 11:58:12.369148 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a55cc-4dac-40c4-82f4-992c6416bf8b None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:58:12.369682 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a55cc-4dac-40c4-82f4-992c6416bf8b None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:58:12.369682 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a55cc-4dac-40c4-82f4-992c6416bf8b None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:58:12.370972 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 533/1076] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 11:58:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:58:12.376197 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2bc898-98d2-4556-9756-90fad88bc18f None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:58:12.377091 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2bc898-98d2-4556-9756-90fad88bc18f None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:58:12.377273 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2bc898-98d2-4556-9756-90fad88bc18f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:58:12.395369 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-4d2bc898-98d2-4556-9756-90fad88bc18f None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:58:12.396588 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-4d2bc898-98d2-4556-9756-90fad88bc18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:58:12.404278 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 544/1077] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 11:58:12 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 11:58:12.442629 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a55cc-4dac-40c4-82f4-992c6416bf8b None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:58:12.448008 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=73 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:58:12.454246 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a55cc-4dac-40c4-82f4-992c6416bf8b None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:58:12.458313 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5f2747-1b20-494f-b0bd-59e01ba809ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be63af25271b49b5903e8fe66a62b1d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:58:12.458943 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f2747-1b20-494f-b0bd-59e01ba809ca service neutron] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:58:12.459229 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f2747-1b20-494f-b0bd-59e01ba809ca service neutron] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:58:12.459506 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f2747-1b20-494f-b0bd-59e01ba809ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:58:12.468272 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5f2747-1b20-494f-b0bd-59e01ba809ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:58:12.469697 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5f2747-1b20-494f-b0bd-59e01ba809ca service neutron] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:58:12.478855 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 534/1078] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 11:58:12 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 11:58:14.775596 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cfb88c-5337-417d-a469-3342e2241999 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:58:14.776221 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cfb88c-5337-417d-a469-3342e2241999 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:58:14.776221 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cfb88c-5337-417d-a469-3342e2241999 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:58:14.777592 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 545/1079] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 11:58:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:58:14.783437 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4924ce-bcb3-439f-a702-d8ad88a370e8 None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:58:14.783867 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4924ce-bcb3-439f-a702-d8ad88a370e8 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:58:14.784094 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4924ce-bcb3-439f-a702-d8ad88a370e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:58:14.802501 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-cd4924ce-bcb3-439f-a702-d8ad88a370e8 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:58:14.803685 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-cd4924ce-bcb3-439f-a702-d8ad88a370e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:58:14.811374 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 535/1080] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 11:58:14 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 11:58:14.849395 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cfb88c-5337-417d-a469-3342e2241999 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:58:14.859718 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cfb88c-5337-417d-a469-3342e2241999 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:58:14.863770 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff7674-528c-4b02-9bda-3b9ad97f22ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be63af25271b49b5903e8fe66a62b1d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:58:14.864417 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff7674-528c-4b02-9bda-3b9ad97f22ae service neutron] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:58:14.864695 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff7674-528c-4b02-9bda-3b9ad97f22ae service neutron] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:58:14.864969 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff7674-528c-4b02-9bda-3b9ad97f22ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:58:14.873482 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ff7674-528c-4b02-9bda-3b9ad97f22ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:58:14.874893 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ff7674-528c-4b02-9bda-3b9ad97f22ae service neutron] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:58:14.883850 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 546/1081] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 11:58:14 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 11:58:17.147886 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e9812-d00a-49d7-8345-60f6d781ada2 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:58:17.148457 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e9812-d00a-49d7-8345-60f6d781ada2 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:58:17.148457 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e9812-d00a-49d7-8345-60f6d781ada2 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:58:17.149835 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 536/1082] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 11:58:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:58:17.155141 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e25c5-c441-4838-8433-ca06e71a7345 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:58:17.155566 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e25c5-c441-4838-8433-ca06e71a7345 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:58:17.155705 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e25c5-c441-4838-8433-ca06e71a7345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:58:17.174359 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-ae8e25c5-c441-4838-8433-ca06e71a7345 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:58:17.175536 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-ae8e25c5-c441-4838-8433-ca06e71a7345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:58:17.183194 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 547/1083] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 11:58:17 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 11:58:17.220812 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50e9812-d00a-49d7-8345-60f6d781ada2 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:58:17.231282 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50e9812-d00a-49d7-8345-60f6d781ada2 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:58:17.234726 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b25287c-fbb9-4840-b24e-f2df75efc2fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be63af25271b49b5903e8fe66a62b1d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:58:17.235361 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25287c-fbb9-4840-b24e-f2df75efc2fc service neutron] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:58:17.235636 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25287c-fbb9-4840-b24e-f2df75efc2fc service neutron] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:58:17.236486 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25287c-fbb9-4840-b24e-f2df75efc2fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:58:17.245126 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b25287c-fbb9-4840-b24e-f2df75efc2fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:58:17.246552 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b25287c-fbb9-4840-b24e-f2df75efc2fc service neutron] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:58:17.255754 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 537/1084] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 11:58:17 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 11:58:19.522739 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8070f854-0d8e-49c8-9af7-412f4f925866 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:58:19.523262 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8070f854-0d8e-49c8-9af7-412f4f925866 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:58:19.523262 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8070f854-0d8e-49c8-9af7-412f4f925866 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:58:19.524603 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 548/1085] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 11:58:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:58:19.529760 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca979a4-9d5e-45d8-ac24-df33a22c1095 None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:58:19.530191 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca979a4-9d5e-45d8-ac24-df33a22c1095 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:58:19.530326 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca979a4-9d5e-45d8-ac24-df33a22c1095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:58:19.547646 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-8ca979a4-9d5e-45d8-ac24-df33a22c1095 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:58:19.549393 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-8ca979a4-9d5e-45d8-ac24-df33a22c1095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:58:19.557094 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 538/1086] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 11:58:19 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 11:58:19.596474 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8070f854-0d8e-49c8-9af7-412f4f925866 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:58:19.617989 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8070f854-0d8e-49c8-9af7-412f4f925866 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:58:19.621464 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9140cc9-7b1e-41a3-8aea-7d28a1e52a7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be63af25271b49b5903e8fe66a62b1d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:58:19.622088 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9140cc9-7b1e-41a3-8aea-7d28a1e52a7a service neutron] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:58:19.622369 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9140cc9-7b1e-41a3-8aea-7d28a1e52a7a service neutron] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:58:19.622644 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9140cc9-7b1e-41a3-8aea-7d28a1e52a7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:58:19.631928 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9140cc9-7b1e-41a3-8aea-7d28a1e52a7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:58:19.633356 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9140cc9-7b1e-41a3-8aea-7d28a1e52a7a service neutron] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:58:19.642482 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 549/1087] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 11:58:19 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 11:58:29.542798 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=17 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:58:29.638367 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=23 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:58:53.757665 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f69d6f9-f56d-4692-a842-dcd14e3f1dc2 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:58:53.758271 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f69d6f9-f56d-4692-a842-dcd14e3f1dc2 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:58:53.758271 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f69d6f9-f56d-4692-a842-dcd14e3f1dc2 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:58:53.759571 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 539/1088] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:58:53.764655 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74115c2c-8c90-49ff-a1f4-2472def39952 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:58:53.765095 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74115c2c-8c90-49ff-a1f4-2472def39952 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:58:53.765203 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74115c2c-8c90-49ff-a1f4-2472def39952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:58:53.783846 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-74115c2c-8c90-49ff-a1f4-2472def39952 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:58:53.785041 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-74115c2c-8c90-49ff-a1f4-2472def39952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:58:53.792785 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 550/1089] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:58:53 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 11:58:53.840380 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b639ee3-f8e8-4727-9243-551ab0710e49 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:58:53.840669 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b639ee3-f8e8-4727-9243-551ab0710e49 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:58:53.840943 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b639ee3-f8e8-4727-9243-551ab0710e49 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:58:53.842286 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 540/1090] 10.222.0.44 () {54 vars in 962 bytes} [Wed May 25 11:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:58:53.848038 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597a5bd-00b5-4aa7-8dea-cb1fd3c46975 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:58:53.848330 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597a5bd-00b5-4aa7-8dea-cb1fd3c46975 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:58:53.848612 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597a5bd-00b5-4aa7-8dea-cb1fd3c46975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:58:53.866313 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-a597a5bd-00b5-4aa7-8dea-cb1fd3c46975 None None] MFA Rules not processed for user `bda1409f24a24f51b42043933e30a560`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:58:53.868034 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-a597a5bd-00b5-4aa7-8dea-cb1fd3c46975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:58:53.874437 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 551/1091] 10.222.0.44 () {58 vars in 1059 bytes} [Wed May 25 11:58:53 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 11:58:53.881625 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b639ee3-f8e8-4727-9243-551ab0710e49 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:58:53.892686 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b639ee3-f8e8-4727-9243-551ab0710e49 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:58:53.896060 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a680db-c8cd-407a-a48c-3d3e2325b3ae service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bda1409f24a24f51b42043933e30a560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:58:53.896689 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a680db-c8cd-407a-a48c-3d3e2325b3ae service glance] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:58:53.896969 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a680db-c8cd-407a-a48c-3d3e2325b3ae service glance] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:58:53.897244 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a680db-c8cd-407a-a48c-3d3e2325b3ae service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:58:53.905831 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a680db-c8cd-407a-a48c-3d3e2325b3ae service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:58:53.907904 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a680db-c8cd-407a-a48c-3d3e2325b3ae service glance] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:58:53.918762 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 541/1092] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 11:58:53 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 11:58:56.255359 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61159c1b-285d-4bfe-90c3-4a9d9227f769 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:58:56.255940 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61159c1b-285d-4bfe-90c3-4a9d9227f769 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:58:56.255940 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61159c1b-285d-4bfe-90c3-4a9d9227f769 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:58:56.257325 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 552/1093] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:58:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:58:56.262423 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb1cfa-6cf8-417a-90d2-d311996dca1a None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:58:56.262858 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb1cfa-6cf8-417a-90d2-d311996dca1a None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:58:56.263006 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb1cfa-6cf8-417a-90d2-d311996dca1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:58:56.281031 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-efdb1cfa-6cf8-417a-90d2-d311996dca1a None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:58:56.282826 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-efdb1cfa-6cf8-417a-90d2-d311996dca1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:58:56.290414 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 542/1094] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:58:56 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 11:58:56.315924 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61159c1b-285d-4bfe-90c3-4a9d9227f769 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:58:56.328087 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61159c1b-285d-4bfe-90c3-4a9d9227f769 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:58:56.332985 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe0e21-8009-41b8-8480-fc02bd83f782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7103ef35356d4cd6a0f435bed6b1df47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:58:56.333619 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe0e21-8009-41b8-8480-fc02bd83f782 admin admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:58:56.333924 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe0e21-8009-41b8-8480-fc02bd83f782 admin admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:58:56.334197 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe0e21-8009-41b8-8480-fc02bd83f782 admin admin] PATH_INFO: `/v3/projects` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:58:56.334911 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebe0e21-8009-41b8-8480-fc02bd83f782 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:58:56.336701 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: WARNING py.warnings [None req-bebe0e21-8009-41b8-8480-fc02bd83f782 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 11:58:56.336701 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: warnings.warn(msg) May 25 11:58:56.336701 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: May 25 11:58:56.337847 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebe0e21-8009-41b8-8480-fc02bd83f782 admin admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:58:56.356362 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 553/1095] 10.222.0.44 () {56 vars in 1108 bytes} [Wed May 25 11:58:56 2022] GET /identity/v3/projects => generated 1606 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 11:58:58.651082 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b5387-4b1d-4ef9-86c2-c8b3d1785dad None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:58:58.651617 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b5387-4b1d-4ef9-86c2-c8b3d1785dad None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:58:58.651617 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b5387-4b1d-4ef9-86c2-c8b3d1785dad None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:58:58.653015 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 543/1096] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:58:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:58:58.658337 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3a3db-5bfa-4a78-b99b-5243bb61b1d6 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:58:58.658754 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3a3db-5bfa-4a78-b99b-5243bb61b1d6 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:58:58.658902 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3a3db-5bfa-4a78-b99b-5243bb61b1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:58:58.676307 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-6ac3a3db-5bfa-4a78-b99b-5243bb61b1d6 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:58:58.677503 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-6ac3a3db-5bfa-4a78-b99b-5243bb61b1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:58:58.685134 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 554/1097] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:58:58 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 11:58:58.730191 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b5387-4b1d-4ef9-86c2-c8b3d1785dad None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:58:58.743229 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b5387-4b1d-4ef9-86c2-c8b3d1785dad None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:58:58.748064 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2623a94-411b-4883-85cb-5d8e9263c094 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd25d7a439361492d8d7ba018531a2e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:58:58.748693 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2623a94-411b-4883-85cb-5d8e9263c094 service nova] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:58:58.748978 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2623a94-411b-4883-85cb-5d8e9263c094 service nova] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:58:58.749256 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2623a94-411b-4883-85cb-5d8e9263c094 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:58:58.757669 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2623a94-411b-4883-85cb-5d8e9263c094 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:58:58.759234 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2623a94-411b-4883-85cb-5d8e9263c094 service nova] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:58:58.769218 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 544/1098] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 11:58:58 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 11:59:01.185281 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b33f6d-461f-442a-95e4-651c18d37ced None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:59:01.185747 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b33f6d-461f-442a-95e4-651c18d37ced None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:59:01.185845 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b33f6d-461f-442a-95e4-651c18d37ced None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:59:01.187181 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 555/1099] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:59:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:59:01.192920 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6aedb-cf0a-429a-83cb-7c1df2d59f71 None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:59:01.193358 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6aedb-cf0a-429a-83cb-7c1df2d59f71 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:59:01.193479 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6aedb-cf0a-429a-83cb-7c1df2d59f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:59:01.210704 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-82d6aedb-cf0a-429a-83cb-7c1df2d59f71 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:59:01.211907 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-82d6aedb-cf0a-429a-83cb-7c1df2d59f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:59:01.219525 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 545/1100] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:59:01 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 11:59:01.257303 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b33f6d-461f-442a-95e4-651c18d37ced None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:59:01.268102 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b33f6d-461f-442a-95e4-651c18d37ced None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:59:01.271518 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc7b08-1548-43d0-b6ba-fff72d94b90e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be63af25271b49b5903e8fe66a62b1d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:59:01.272190 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc7b08-1548-43d0-b6ba-fff72d94b90e service neutron] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:59:01.272475 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc7b08-1548-43d0-b6ba-fff72d94b90e service neutron] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:59:01.272755 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc7b08-1548-43d0-b6ba-fff72d94b90e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:59:01.281487 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dc7b08-1548-43d0-b6ba-fff72d94b90e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:59:01.282933 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dc7b08-1548-43d0-b6ba-fff72d94b90e service neutron] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:59:01.292180 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 556/1101] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 11:59:01 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 11:59:03.613131 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f7e20-37ce-42d5-b711-4c1cf1f92bd9 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:59:03.613693 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f7e20-37ce-42d5-b711-4c1cf1f92bd9 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:59:03.613693 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f7e20-37ce-42d5-b711-4c1cf1f92bd9 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:59:03.615024 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 546/1102] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:59:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:59:03.620319 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843fbb6-d47e-438d-80ef-f3a0ef9b2a1c None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:59:03.620735 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843fbb6-d47e-438d-80ef-f3a0ef9b2a1c None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:59:03.620890 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843fbb6-d47e-438d-80ef-f3a0ef9b2a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:59:03.637985 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-1843fbb6-d47e-438d-80ef-f3a0ef9b2a1c None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:59:03.639168 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-1843fbb6-d47e-438d-80ef-f3a0ef9b2a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:59:03.647518 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 557/1103] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:59:03 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 11:59:03.686231 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f7e20-37ce-42d5-b711-4c1cf1f92bd9 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:59:03.697071 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f7e20-37ce-42d5-b711-4c1cf1f92bd9 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:59:03.700577 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d647ac01-978d-4e4f-a1a7-c534129c1aa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be63af25271b49b5903e8fe66a62b1d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:59:03.701206 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647ac01-978d-4e4f-a1a7-c534129c1aa3 service neutron] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:59:03.701485 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647ac01-978d-4e4f-a1a7-c534129c1aa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:59:03.701759 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647ac01-978d-4e4f-a1a7-c534129c1aa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:59:03.710996 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d647ac01-978d-4e4f-a1a7-c534129c1aa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:59:03.712454 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d647ac01-978d-4e4f-a1a7-c534129c1aa3 service neutron] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:59:03.722103 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 547/1104] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 11:59:03 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 11:59:06.132968 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21dc5e-5276-4cd0-a68f-20bf68549c4b None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:59:06.133513 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21dc5e-5276-4cd0-a68f-20bf68549c4b None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:59:06.133513 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21dc5e-5276-4cd0-a68f-20bf68549c4b None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:59:06.134867 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 558/1105] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:59:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:59:06.140246 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893055a-cecb-4a7a-a19b-974ecfced695 None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:59:06.140652 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893055a-cecb-4a7a-a19b-974ecfced695 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:59:06.140807 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893055a-cecb-4a7a-a19b-974ecfced695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:59:06.158632 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-a893055a-cecb-4a7a-a19b-974ecfced695 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:59:06.159830 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-a893055a-cecb-4a7a-a19b-974ecfced695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:59:06.167545 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 548/1106] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:59:06 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 11:59:06.210658 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21dc5e-5276-4cd0-a68f-20bf68549c4b None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:59:06.221834 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21dc5e-5276-4cd0-a68f-20bf68549c4b None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:59:06.225256 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3bda85-eae3-4e6b-8135-e61d24ccc4c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be63af25271b49b5903e8fe66a62b1d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:59:06.225882 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3bda85-eae3-4e6b-8135-e61d24ccc4c6 service neutron] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:59:06.226162 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3bda85-eae3-4e6b-8135-e61d24ccc4c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:59:06.226438 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3bda85-eae3-4e6b-8135-e61d24ccc4c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:59:06.235717 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3bda85-eae3-4e6b-8135-e61d24ccc4c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:59:06.237173 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3bda85-eae3-4e6b-8135-e61d24ccc4c6 service neutron] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:59:06.246327 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 559/1107] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 11:59:06 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 11:59:08.717381 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d08fe7-251b-4846-b59b-afc029218121 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:59:08.717954 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d08fe7-251b-4846-b59b-afc029218121 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:59:08.717954 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d08fe7-251b-4846-b59b-afc029218121 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:59:08.719384 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 549/1108] 10.222.0.44 () {54 vars in 926 bytes} [Wed May 25 11:59:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 11:59:08.724843 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f533e-c223-4d45-9baa-ec9ee6a48cce None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:59:08.725280 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f533e-c223-4d45-9baa-ec9ee6a48cce None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:59:08.725404 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f533e-c223-4d45-9baa-ec9ee6a48cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:59:08.743139 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-a44f533e-c223-4d45-9baa-ec9ee6a48cce None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 11:59:08.744364 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-a44f533e-c223-4d45-9baa-ec9ee6a48cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 11:59:08.752729 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 560/1109] 10.222.0.44 () {58 vars in 1023 bytes} [Wed May 25 11:59:08 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 11:59:08.792570 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d08fe7-251b-4846-b59b-afc029218121 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 11:59:08.803631 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d08fe7-251b-4846-b59b-afc029218121 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 11:59:08.807091 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ea235-402b-44ce-8e52-43e850859d19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be63af25271b49b5903e8fe66a62b1d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 11:59:08.807714 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ea235-402b-44ce-8e52-43e850859d19 service neutron] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 11:59:08.808032 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ea235-402b-44ce-8e52-43e850859d19 service neutron] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 11:59:08.808306 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ea235-402b-44ce-8e52-43e850859d19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 11:59:08.817674 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132ea235-402b-44ce-8e52-43e850859d19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 11:59:08.820514 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132ea235-402b-44ce-8e52-43e850859d19 service neutron] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 11:59:08.833984 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 550/1110] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 11:59:08 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 11:59:18.738123 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=33 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 11:59:18.827454 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=33 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 12:00:57.582143 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d497d04-9a1f-4917-aa48-75118ecf70a3 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:00:57.582722 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d497d04-9a1f-4917-aa48-75118ecf70a3 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:00:57.582722 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d497d04-9a1f-4917-aa48-75118ecf70a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:00:57.600688 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-9d497d04-9a1f-4917-aa48-75118ecf70a3 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 12:00:57.601881 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-9d497d04-9a1f-4917-aa48-75118ecf70a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:00:57.609492 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 561/1111] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 25 12:00:57 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 12:00:57.618510 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2cd5f-63e3-4ec5-b065-4a1267cd26bb None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:00:57.619025 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2cd5f-63e3-4ec5-b065-4a1267cd26bb None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:00:57.619127 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2cd5f-63e3-4ec5-b065-4a1267cd26bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:00:57.636453 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-44f2cd5f-63e3-4ec5-b065-4a1267cd26bb None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 12:00:57.638306 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-44f2cd5f-63e3-4ec5-b065-4a1267cd26bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:00:57.646210 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 551/1112] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 25 12:00:57 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 12:00:57.650551 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d497d04-9a1f-4917-aa48-75118ecf70a3 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:00:57.660540 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d497d04-9a1f-4917-aa48-75118ecf70a3 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:00:57.664974 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9637cc27-7b1a-4d80-a55d-a94758b826bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7103ef35356d4cd6a0f435bed6b1df47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:00:57.665614 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637cc27-7b1a-4d80-a55d-a94758b826bd admin admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:00:57.665894 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637cc27-7b1a-4d80-a55d-a94758b826bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:00:57.666165 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637cc27-7b1a-4d80-a55d-a94758b826bd admin admin] PATH_INFO: `/v3/domains` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:00:57.666870 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9637cc27-7b1a-4d80-a55d-a94758b826bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 12:00:57.667174 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9637cc27-7b1a-4d80-a55d-a94758b826bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:00:57.668209 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: WARNING py.warnings [None req-9637cc27-7b1a-4d80-a55d-a94758b826bd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 12:00:57.668209 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: warnings.warn(msg) May 25 12:00:57.668209 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: May 25 12:00:57.669099 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9637cc27-7b1a-4d80-a55d-a94758b826bd admin admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:00:57.680083 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 562/1113] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 25 12:00:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 12:00:57.687961 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f2cd5f-63e3-4ec5-b065-4a1267cd26bb None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:00:57.696811 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f2cd5f-63e3-4ec5-b065-4a1267cd26bb None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:00:57.701805 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dfc64d-7f89-4f17-8c67-5ec7e858f06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7103ef35356d4cd6a0f435bed6b1df47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:00:57.702434 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dfc64d-7f89-4f17-8c67-5ec7e858f06d admin admin] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:00:57.702721 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dfc64d-7f89-4f17-8c67-5ec7e858f06d admin admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:00:57.702990 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dfc64d-7f89-4f17-8c67-5ec7e858f06d admin admin] PATH_INFO: `/v3/projects` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:00:57.703662 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dfc64d-7f89-4f17-8c67-5ec7e858f06d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:00:57.705417 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: WARNING py.warnings [None req-72dfc64d-7f89-4f17-8c67-5ec7e858f06d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 12:00:57.705417 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: warnings.warn(msg) May 25 12:00:57.705417 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: May 25 12:00:57.706609 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dfc64d-7f89-4f17-8c67-5ec7e858f06d admin admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:00:57.732404 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 552/1114] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 25 12:00:57 2022] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 12:00:57.736499 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9637cc27-7b1a-4d80-a55d-a94758b826bd admin admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:00:57.746470 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9637cc27-7b1a-4d80-a55d-a94758b826bd admin admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:00:57.800283 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139db79-b5ce-486e-b818-31b8039d1343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7103ef35356d4cd6a0f435bed6b1df47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:00:57.800939 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139db79-b5ce-486e-b818-31b8039d1343 admin admin] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:00:57.801226 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139db79-b5ce-486e-b818-31b8039d1343 admin admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:00:57.801505 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139db79-b5ce-486e-b818-31b8039d1343 admin admin] PATH_INFO: `/v3/users` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:00:57.802182 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1139db79-b5ce-486e-b818-31b8039d1343 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:00:57.803191 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: WARNING py.warnings [None req-1139db79-b5ce-486e-b818-31b8039d1343 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 12:00:57.803191 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: warnings.warn(msg) May 25 12:00:57.803191 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: May 25 12:00:57.804421 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1139db79-b5ce-486e-b818-31b8039d1343 admin admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:00:57.824256 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 563/1115] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 25 12:00:57 2022] POST /identity/v3/users => generated 290 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 12:00:57.828527 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dfc64d-7f89-4f17-8c67-5ec7e858f06d admin admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:00:57.838596 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dfc64d-7f89-4f17-8c67-5ec7e858f06d admin admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:00:57.843646 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29779840-9a2d-4754-8b64-358ed8b1fd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7103ef35356d4cd6a0f435bed6b1df47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:00:57.844336 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29779840-9a2d-4754-8b64-358ed8b1fd64 admin admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:00:57.844617 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29779840-9a2d-4754-8b64-358ed8b1fd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:00:57.844892 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29779840-9a2d-4754-8b64-358ed8b1fd64 admin admin] PATH_INFO: `/v3/roles` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:00:57.845606 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29779840-9a2d-4754-8b64-358ed8b1fd64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:00:57.846638 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: WARNING py.warnings [None req-29779840-9a2d-4754-8b64-358ed8b1fd64 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 12:00:57.846638 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: warnings.warn(msg) May 25 12:00:57.846638 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: May 25 12:00:57.847511 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29779840-9a2d-4754-8b64-358ed8b1fd64 admin admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:00:57.861076 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 553/1116] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 25 12:00:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 12:00:57.864828 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139db79-b5ce-486e-b818-31b8039d1343 admin admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:00:57.874676 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139db79-b5ce-486e-b818-31b8039d1343 admin admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:00:57.879260 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dce7e1-2852-44ae-8aa3-2ddae1a49370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7103ef35356d4cd6a0f435bed6b1df47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:00:57.879940 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dce7e1-2852-44ae-8aa3-2ddae1a49370 admin admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:00:57.880222 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dce7e1-2852-44ae-8aa3-2ddae1a49370 admin admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:00:57.880496 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dce7e1-2852-44ae-8aa3-2ddae1a49370 admin admin] PATH_INFO: `/v3/roles` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:00:57.881202 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dce7e1-2852-44ae-8aa3-2ddae1a49370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:00:57.882210 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: WARNING py.warnings [None req-e1dce7e1-2852-44ae-8aa3-2ddae1a49370 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 12:00:57.882210 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: warnings.warn(msg) May 25 12:00:57.882210 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: May 25 12:00:57.883073 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dce7e1-2852-44ae-8aa3-2ddae1a49370 admin admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:00:57.896066 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 564/1117] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 25 12:00:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 12:00:57.899908 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29779840-9a2d-4754-8b64-358ed8b1fd64 admin admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:00:57.910380 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29779840-9a2d-4754-8b64-358ed8b1fd64 admin admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:00:57.918377 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56072645-c3fa-43b3-9712-cd651f054499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7103ef35356d4cd6a0f435bed6b1df47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:00:57.919937 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56072645-c3fa-43b3-9712-cd651f054499 admin admin] REQUEST_METHOD: `PUT` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:00:57.920247 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56072645-c3fa-43b3-9712-cd651f054499 admin admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:00:57.920523 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56072645-c3fa-43b3-9712-cd651f054499 admin admin] PATH_INFO: `/v3/projects/f6c1b24fd64e40b6b91c3170a225051c/users/a46fb48dc77c49e48babb207a8c25f04/roles/0bb7b8a3ae8f4d03a7f575ca8904963c` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:00:57.935076 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56072645-c3fa-43b3-9712-cd651f054499 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6c1b24fd64e40b6b91c3170a225051c, user_id=a46fb48dc77c49e48babb207a8c25f04, role_id=0bb7b8a3ae8f4d03a7f575ca8904963c)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:00:57.936125 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: WARNING py.warnings [None req-56072645-c3fa-43b3-9712-cd651f054499 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 12:00:57.936125 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: warnings.warn(msg) May 25 12:00:57.936125 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: May 25 12:00:57.938078 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56072645-c3fa-43b3-9712-cd651f054499 admin admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:00:57.950703 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 554/1118] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 25 12:00:57 2022] PUT /identity/v3/projects/f6c1b24fd64e40b6b91c3170a225051c/users/a46fb48dc77c49e48babb207a8c25f04/roles/0bb7b8a3ae8f4d03a7f575ca8904963c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 12:00:57.961963 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9abd6-0d07-41b0-8628-0ddd8075dfad None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:00:57.962251 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9abd6-0d07-41b0-8628-0ddd8075dfad None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:00:57.962562 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9abd6-0d07-41b0-8628-0ddd8075dfad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:00:57.989233 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-67c9abd6-0d07-41b0-8628-0ddd8075dfad None None] MFA Rules not processed for user `a46fb48dc77c49e48babb207a8c25f04`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 12:00:57.990440 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-67c9abd6-0d07-41b0-8628-0ddd8075dfad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:00:58.052488 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 565/1119] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 25 12:00:57 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 12:00:58.065614 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e95ca3-756f-4c7b-8da9-1f2d3215f375 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:00:58.065907 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e95ca3-756f-4c7b-8da9-1f2d3215f375 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:00:58.066189 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e95ca3-756f-4c7b-8da9-1f2d3215f375 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:00:58.067577 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 555/1120] 10.222.0.44 () {54 vars in 963 bytes} [Wed May 25 12:00:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 12:00:58.072436 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07b593-3af4-43b7-80b0-ac5ea7edae0d None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:00:58.072728 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07b593-3af4-43b7-80b0-ac5ea7edae0d None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:00:58.073007 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07b593-3af4-43b7-80b0-ac5ea7edae0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:00:58.091147 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-6d07b593-3af4-43b7-80b0-ac5ea7edae0d None None] MFA Rules not processed for user `9c940de37d2d453c875d3ab6c077a331`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 12:00:58.092359 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-6d07b593-3af4-43b7-80b0-ac5ea7edae0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:00:58.133676 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 12:00:58.141976 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 566/1121] 10.222.0.44 () {58 vars in 1060 bytes} [Wed May 25 12:00:58 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 12:00:58.149463 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e95ca3-756f-4c7b-8da9-1f2d3215f375 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:00:58.160380 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e95ca3-756f-4c7b-8da9-1f2d3215f375 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:00:58.163862 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ffa64e-fda9-496a-823c-bd09f85d0f64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c940de37d2d453c875d3ab6c077a331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:00:58.164496 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ffa64e-fda9-496a-823c-bd09f85d0f64 service cinder] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:00:58.164783 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ffa64e-fda9-496a-823c-bd09f85d0f64 service cinder] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:00:58.165057 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ffa64e-fda9-496a-823c-bd09f85d0f64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:00:58.173940 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ffa64e-fda9-496a-823c-bd09f85d0f64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:00:58.175382 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ffa64e-fda9-496a-823c-bd09f85d0f64 service cinder] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:00:58.184224 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 556/1122] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 12:00:58 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 12:00:58.218711 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a976d-7bc5-4695-bb2a-1f4ea23fe466 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:00:58.219005 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a976d-7bc5-4695-bb2a-1f4ea23fe466 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:00:58.219287 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a976d-7bc5-4695-bb2a-1f4ea23fe466 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:00:58.220583 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 567/1123] 10.222.0.44 () {52 vars in 829 bytes} [Wed May 25 12:00:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 12:00:58.224439 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ffa64e-fda9-496a-823c-bd09f85d0f64 service cinder] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:00:58.284857 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ffa64e-fda9-496a-823c-bd09f85d0f64 service cinder] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:00:58.289372 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b9280-9538-421e-8c4f-b79d84118520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7103ef35356d4cd6a0f435bed6b1df47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:00:58.290295 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b9280-9538-421e-8c4f-b79d84118520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:00:58.290587 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b9280-9538-421e-8c4f-b79d84118520 admin admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:00:58.290867 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b9280-9538-421e-8c4f-b79d84118520 admin admin] PATH_INFO: `/v3/users/a46fb48dc77c49e48babb207a8c25f04` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:00:58.292081 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3b9280-9538-421e-8c4f-b79d84118520 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a46fb48dc77c49e48babb207a8c25f04)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:00:58.293097 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: WARNING py.warnings [None req-6d3b9280-9538-421e-8c4f-b79d84118520 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 12:00:58.293097 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: warnings.warn(msg) May 25 12:00:58.293097 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: May 25 12:00:58.294335 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3b9280-9538-421e-8c4f-b79d84118520 admin admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:00:58.355710 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.notifications [None req-6d3b9280-9538-421e-8c4f-b79d84118520 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a46fb48dc77c49e48babb207a8c25f04'} {{(pid=86938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 12:00:58.367778 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.notifications [None req-6d3b9280-9538-421e-8c4f-b79d84118520 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a46fb48dc77c49e48babb207a8c25f04'} {{(pid=86938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 12:00:58.368648 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.notifications [None req-6d3b9280-9538-421e-8c4f-b79d84118520 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a46fb48dc77c49e48babb207a8c25f04'} {{(pid=86938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 12:00:58.388554 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.notifications [None req-6d3b9280-9538-421e-8c4f-b79d84118520 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a46fb48dc77c49e48babb207a8c25f04'} {{(pid=86938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 12:00:58.397763 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.notifications [None req-6d3b9280-9538-421e-8c4f-b79d84118520 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a46fb48dc77c49e48babb207a8c25f04'} {{(pid=86938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 12:00:58.404147 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 557/1124] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 25 12:00:58 2022] DELETE /identity/v3/users/a46fb48dc77c49e48babb207a8c25f04 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 12:00:58.408572 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8125839-e27e-42d3-a6f7-f883a203f811 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:00:58.408868 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8125839-e27e-42d3-a6f7-f883a203f811 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:00:58.409153 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8125839-e27e-42d3-a6f7-f883a203f811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:00:58.426167 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-e8125839-e27e-42d3-a6f7-f883a203f811 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 12:00:58.427412 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-e8125839-e27e-42d3-a6f7-f883a203f811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:00:58.484635 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 568/1125] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 25 12:00:58 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 12:00:58.494479 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b9280-9538-421e-8c4f-b79d84118520 admin admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:00:58.495901 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-6d3b9280-9538-421e-8c4f-b79d84118520 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:00:58.506595 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 12:00:58.560264 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b9280-9538-421e-8c4f-b79d84118520 admin admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:00:58.563882 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a796ab5-a632-4051-b808-993308386353 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be63af25271b49b5903e8fe66a62b1d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:00:58.564553 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a796ab5-a632-4051-b808-993308386353 service neutron] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:00:58.564838 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a796ab5-a632-4051-b808-993308386353 service neutron] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:00:58.565115 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a796ab5-a632-4051-b808-993308386353 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:00:58.573881 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a796ab5-a632-4051-b808-993308386353 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:00:58.575963 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a796ab5-a632-4051-b808-993308386353 service neutron] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:00:58.585163 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 558/1126] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 12:00:58 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 12:00:58.921676 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8125839-e27e-42d3-a6f7-f883a203f811 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:00:58.923013 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-e8125839-e27e-42d3-a6f7-f883a203f811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:00:58.936140 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8125839-e27e-42d3-a6f7-f883a203f811 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:00:58.940811 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda25adc-bbd1-463e-be0f-7a0a2b4d1ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7103ef35356d4cd6a0f435bed6b1df47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:00:58.941697 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda25adc-bbd1-463e-be0f-7a0a2b4d1ae2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:00:58.941991 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda25adc-bbd1-463e-be0f-7a0a2b4d1ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:00:58.942274 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda25adc-bbd1-463e-be0f-7a0a2b4d1ae2 admin admin] PATH_INFO: `/v3/projects/f6c1b24fd64e40b6b91c3170a225051c` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:00:58.943455 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda25adc-bbd1-463e-be0f-7a0a2b4d1ae2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6c1b24fd64e40b6b91c3170a225051c)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:00:58.944614 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: WARNING py.warnings [None req-eda25adc-bbd1-463e-be0f-7a0a2b4d1ae2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 12:00:58.944614 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: warnings.warn(msg) May 25 12:00:58.944614 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: May 25 12:00:58.945772 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda25adc-bbd1-463e-be0f-7a0a2b4d1ae2 admin admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:00:59.009237 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.notifications [None req-eda25adc-bbd1-463e-be0f-7a0a2b4d1ae2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6c1b24fd64e40b6b91c3170a225051c', 'request_id': 'req-eda25adc-bbd1-463e-be0f-7a0a2b4d1ae2'} {{(pid=86939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 12:00:59.022391 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.notifications [None req-eda25adc-bbd1-463e-be0f-7a0a2b4d1ae2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6c1b24fd64e40b6b91c3170a225051c', 'request_id': 'req-eda25adc-bbd1-463e-be0f-7a0a2b4d1ae2'} {{(pid=86939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 12:00:59.028380 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.notifications [None req-eda25adc-bbd1-463e-be0f-7a0a2b4d1ae2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6c1b24fd64e40b6b91c3170a225051c', 'request_id': 'req-eda25adc-bbd1-463e-be0f-7a0a2b4d1ae2'} {{(pid=86939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 12:00:59.042797 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.notifications [None req-eda25adc-bbd1-463e-be0f-7a0a2b4d1ae2 admin admin] The token cache is being invalidate because project f6c1b24fd64e40b6b91c3170a225051c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86939) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 12:00:59.043093 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.notifications [None req-eda25adc-bbd1-463e-be0f-7a0a2b4d1ae2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 12:00:59.044255 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.notifications [None req-eda25adc-bbd1-463e-be0f-7a0a2b4d1ae2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 12:00:59.045909 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 569/1127] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 25 12:00:58 2022] DELETE /identity/v3/projects/f6c1b24fd64e40b6b91c3170a225051c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 12:01:08.581156 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=25 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 12:01:09.039585 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 12:02:23.769774 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30152c8-56fe-4b40-aa5f-4ba2d9b461f8 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:02:23.770348 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30152c8-56fe-4b40-aa5f-4ba2d9b461f8 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:02:23.770348 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30152c8-56fe-4b40-aa5f-4ba2d9b461f8 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:02:23.771677 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 559/1128] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 12:02:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 12:02:23.776533 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917009ad-8b3a-4641-91a5-19e8af64a60a None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:02:23.777008 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917009ad-8b3a-4641-91a5-19e8af64a60a None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:02:23.777131 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917009ad-8b3a-4641-91a5-19e8af64a60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:02:23.841536 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-917009ad-8b3a-4641-91a5-19e8af64a60a None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 12:02:23.842667 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-917009ad-8b3a-4641-91a5-19e8af64a60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:02:23.934868 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 570/1129] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 12:02:23 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 12:02:24.105935 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30152c8-56fe-4b40-aa5f-4ba2d9b461f8 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:02:24.107585 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-f30152c8-56fe-4b40-aa5f-4ba2d9b461f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:02:24.193355 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30152c8-56fe-4b40-aa5f-4ba2d9b461f8 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:02:24.198338 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2646aed4-8b74-48a4-a0ad-9edd91b574c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd25d7a439361492d8d7ba018531a2e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:02:24.199005 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646aed4-8b74-48a4-a0ad-9edd91b574c3 service nova] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:02:24.199287 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646aed4-8b74-48a4-a0ad-9edd91b574c3 service nova] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:02:24.199563 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646aed4-8b74-48a4-a0ad-9edd91b574c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:02:24.207397 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2646aed4-8b74-48a4-a0ad-9edd91b574c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:02:24.208998 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2646aed4-8b74-48a4-a0ad-9edd91b574c3 service nova] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:02:24.218597 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 560/1130] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 12:02:24 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 12:02:25.098945 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64267e-ba7e-40d9-8b69-d0705a2b7f4f None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:02:25.099532 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64267e-ba7e-40d9-8b69-d0705a2b7f4f None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:02:25.099532 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64267e-ba7e-40d9-8b69-d0705a2b7f4f None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:02:25.100917 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 571/1131] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 12:02:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 12:02:25.105540 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b2221-2195-495c-9f9b-cbd3fcc25139 None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:02:25.105982 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b2221-2195-495c-9f9b-cbd3fcc25139 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:02:25.106093 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b2221-2195-495c-9f9b-cbd3fcc25139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:02:25.124578 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-762b2221-2195-495c-9f9b-cbd3fcc25139 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 12:02:25.125783 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-762b2221-2195-495c-9f9b-cbd3fcc25139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:02:25.133633 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 561/1132] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 12:02:25 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 12:02:25.287625 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c64267e-ba7e-40d9-8b69-d0705a2b7f4f None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:02:25.301340 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c64267e-ba7e-40d9-8b69-d0705a2b7f4f None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:02:25.306279 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee1af2-9b1a-4892-9629-7486702982cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd25d7a439361492d8d7ba018531a2e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:02:25.306911 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee1af2-9b1a-4892-9629-7486702982cf service nova] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:02:25.307196 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee1af2-9b1a-4892-9629-7486702982cf service nova] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:02:25.307479 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee1af2-9b1a-4892-9629-7486702982cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:02:25.316414 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ee1af2-9b1a-4892-9629-7486702982cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:02:25.318039 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ee1af2-9b1a-4892-9629-7486702982cf service nova] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:02:25.328442 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 572/1133] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 12:02:25 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 12:02:30.097534 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc98e53-e03a-4fbd-a984-4e886a358cab None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:02:30.098077 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc98e53-e03a-4fbd-a984-4e886a358cab None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:02:30.098077 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc98e53-e03a-4fbd-a984-4e886a358cab None None] PATH_INFO: `/v3` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:02:30.099368 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 562/1134] 10.222.0.60 () {54 vars in 925 bytes} [Wed May 25 12:02:30 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 12:02:30.105884 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88552651-2edb-4cb0-a799-6bb345c8f799 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:02:30.106301 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88552651-2edb-4cb0-a799-6bb345c8f799 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:02:30.106452 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88552651-2edb-4cb0-a799-6bb345c8f799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:02:30.134435 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-88552651-2edb-4cb0-a799-6bb345c8f799 None None] MFA Rules not processed for user `94f4a0c602a7495dbb36dd768cc55a47`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 12:02:30.135647 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-88552651-2edb-4cb0-a799-6bb345c8f799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:02:30.190584 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 12:02:30.200741 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 573/1135] 10.222.0.60 () {58 vars in 1015 bytes} [Wed May 25 12:02:30 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 12:02:34.305491 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afde76f-d21b-4712-953d-e369fe0c50ed None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:02:34.305975 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afde76f-d21b-4712-953d-e369fe0c50ed None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:02:34.305975 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afde76f-d21b-4712-953d-e369fe0c50ed None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:02:34.307354 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 563/1136] 10.222.0.44 () {54 vars in 960 bytes} [Wed May 25 12:02:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 12:02:34.312196 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469bfbf-bcda-4cc2-b2b7-980e358f55bc None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:02:34.312617 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469bfbf-bcda-4cc2-b2b7-980e358f55bc None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:02:34.312785 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469bfbf-bcda-4cc2-b2b7-980e358f55bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:02:34.332345 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-5469bfbf-bcda-4cc2-b2b7-980e358f55bc None None] MFA Rules not processed for user `94f4a0c602a7495dbb36dd768cc55a47`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 12:02:34.333525 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-5469bfbf-bcda-4cc2-b2b7-980e358f55bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:02:34.342452 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 574/1137] 10.222.0.44 () {58 vars in 1057 bytes} [Wed May 25 12:02:34 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 12:02:34.349471 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afde76f-d21b-4712-953d-e369fe0c50ed None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:02:34.362219 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afde76f-d21b-4712-953d-e369fe0c50ed None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:02:34.366951 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b329f7b9-8138-49d3-8fe9-21f98b802af7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94f4a0c602a7495dbb36dd768cc55a47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:02:34.367589 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329f7b9-8138-49d3-8fe9-21f98b802af7 service placement] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:02:34.367978 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329f7b9-8138-49d3-8fe9-21f98b802af7 service placement] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:02:34.368256 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329f7b9-8138-49d3-8fe9-21f98b802af7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:02:34.376208 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b329f7b9-8138-49d3-8fe9-21f98b802af7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:02:34.377763 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b329f7b9-8138-49d3-8fe9-21f98b802af7 service placement] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:02:34.387543 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 564/1138] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 12:02:34 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 12:02:36.631885 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3cafc3-7c6e-471a-8993-9aa1a01cb5a3 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:02:36.632461 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3cafc3-7c6e-471a-8993-9aa1a01cb5a3 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:02:36.632461 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3cafc3-7c6e-471a-8993-9aa1a01cb5a3 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:02:36.633787 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 575/1139] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 12:02:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 12:02:36.639999 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030af31-0b8f-420c-8b2f-2e619f75ea6b None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:02:36.640429 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030af31-0b8f-420c-8b2f-2e619f75ea6b None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:02:36.640540 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030af31-0b8f-420c-8b2f-2e619f75ea6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:02:36.658757 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-b030af31-0b8f-420c-8b2f-2e619f75ea6b None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 12:02:36.659988 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-b030af31-0b8f-420c-8b2f-2e619f75ea6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:02:36.667685 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 565/1140] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 12:02:36 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 12:02:36.828516 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3cafc3-7c6e-471a-8993-9aa1a01cb5a3 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:02:36.842007 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3cafc3-7c6e-471a-8993-9aa1a01cb5a3 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:02:36.846889 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e5a1d5-bb6b-4e86-ba59-410c59f06768 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd25d7a439361492d8d7ba018531a2e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:02:36.847521 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5a1d5-bb6b-4e86-ba59-410c59f06768 service nova] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:02:36.847813 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5a1d5-bb6b-4e86-ba59-410c59f06768 service nova] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:02:36.848111 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5a1d5-bb6b-4e86-ba59-410c59f06768 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:02:36.856137 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e5a1d5-bb6b-4e86-ba59-410c59f06768 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:02:36.857728 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e5a1d5-bb6b-4e86-ba59-410c59f06768 service nova] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:02:36.866826 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 576/1141] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 12:02:36 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 12:02:37.728035 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216327f-9820-47d7-915d-042e34a9adc0 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:02:37.728568 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216327f-9820-47d7-915d-042e34a9adc0 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:02:37.728684 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216327f-9820-47d7-915d-042e34a9adc0 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:02:37.730578 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 566/1142] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 12:02:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 12:02:37.735204 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe55bb-42fd-4d62-876a-e43a9c81e592 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:02:37.735659 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe55bb-42fd-4d62-876a-e43a9c81e592 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:02:37.735764 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe55bb-42fd-4d62-876a-e43a9c81e592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:02:37.753751 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-98fe55bb-42fd-4d62-876a-e43a9c81e592 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 12:02:37.754941 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-98fe55bb-42fd-4d62-876a-e43a9c81e592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:02:37.762671 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 577/1143] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 12:02:37 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 12:02:37.914720 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216327f-9820-47d7-915d-042e34a9adc0 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:02:37.929081 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216327f-9820-47d7-915d-042e34a9adc0 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:02:37.937861 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd45faf-59c2-4a74-8387-49708e4fa1f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd25d7a439361492d8d7ba018531a2e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:02:37.938500 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd45faf-59c2-4a74-8387-49708e4fa1f7 service nova] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:02:37.938783 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd45faf-59c2-4a74-8387-49708e4fa1f7 service nova] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:02:37.939060 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd45faf-59c2-4a74-8387-49708e4fa1f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:02:37.947197 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd45faf-59c2-4a74-8387-49708e4fa1f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:02:37.949332 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd45faf-59c2-4a74-8387-49708e4fa1f7 service nova] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:02:37.958902 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 567/1144] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 12:02:37 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 12:02:42.273043 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ba5b9-197b-49fa-a5ea-4e4586d300f3 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:02:42.273646 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ba5b9-197b-49fa-a5ea-4e4586d300f3 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:02:42.273646 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ba5b9-197b-49fa-a5ea-4e4586d300f3 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:02:42.274862 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 578/1145] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 12:02:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 12:02:42.280548 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03878a-ba10-483e-a262-f83eef1b8421 None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:02:42.280986 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03878a-ba10-483e-a262-f83eef1b8421 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:02:42.281139 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03878a-ba10-483e-a262-f83eef1b8421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:02:42.299940 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-0d03878a-ba10-483e-a262-f83eef1b8421 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 12:02:42.301139 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-0d03878a-ba10-483e-a262-f83eef1b8421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:02:42.308853 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 568/1146] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 12:02:42 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 12:02:42.345395 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6ba5b9-197b-49fa-a5ea-4e4586d300f3 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:02:42.347040 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-0d6ba5b9-197b-49fa-a5ea-4e4586d300f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:02:42.407305 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6ba5b9-197b-49fa-a5ea-4e4586d300f3 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:02:42.410831 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d07f7ba-48e2-4f5e-800d-87c5d583fa17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be63af25271b49b5903e8fe66a62b1d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:02:42.411474 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d07f7ba-48e2-4f5e-800d-87c5d583fa17 service neutron] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:02:42.411760 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d07f7ba-48e2-4f5e-800d-87c5d583fa17 service neutron] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:02:42.412071 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d07f7ba-48e2-4f5e-800d-87c5d583fa17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:02:42.421701 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d07f7ba-48e2-4f5e-800d-87c5d583fa17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:02:42.423126 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d07f7ba-48e2-4f5e-800d-87c5d583fa17 service neutron] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:02:42.432364 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 579/1147] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 12:02:42 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 12:02:44.706774 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4251b7-4738-4f8c-bf68-bb7d3c2513a0 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:02:44.707351 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4251b7-4738-4f8c-bf68-bb7d3c2513a0 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:02:44.707351 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4251b7-4738-4f8c-bf68-bb7d3c2513a0 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:02:44.708758 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 569/1148] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 12:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 12:02:44.713965 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eae77e-05dd-46c5-b3c6-81994330aa77 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:02:44.714390 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eae77e-05dd-46c5-b3c6-81994330aa77 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:02:44.714527 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eae77e-05dd-46c5-b3c6-81994330aa77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:02:44.743147 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-02eae77e-05dd-46c5-b3c6-81994330aa77 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 12:02:44.744407 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-02eae77e-05dd-46c5-b3c6-81994330aa77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:02:44.752984 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 580/1149] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 12:02:44 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 12:02:44.789678 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4251b7-4738-4f8c-bf68-bb7d3c2513a0 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:02:44.801155 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4251b7-4738-4f8c-bf68-bb7d3c2513a0 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:02:44.804645 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef542928-f164-4ae4-96e9-29577dcb4fb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be63af25271b49b5903e8fe66a62b1d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:02:44.805281 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef542928-f164-4ae4-96e9-29577dcb4fb9 service neutron] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:02:44.805567 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef542928-f164-4ae4-96e9-29577dcb4fb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:02:44.805849 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef542928-f164-4ae4-96e9-29577dcb4fb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:02:44.815146 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef542928-f164-4ae4-96e9-29577dcb4fb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:02:44.816617 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef542928-f164-4ae4-96e9-29577dcb4fb9 service neutron] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:02:44.825899 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 570/1150] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 12:02:44 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 12:02:48.721678 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1c9fe-55de-4b97-a81c-bd3420771b36 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:02:48.722245 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1c9fe-55de-4b97-a81c-bd3420771b36 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:02:48.722245 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1c9fe-55de-4b97-a81c-bd3420771b36 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:02:48.723623 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 581/1151] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 12:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 12:02:48.728825 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5b7d9-745e-4487-a498-a7206d4f0fe4 None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:02:48.729248 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5b7d9-745e-4487-a498-a7206d4f0fe4 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:02:48.729394 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5b7d9-745e-4487-a498-a7206d4f0fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:02:48.735663 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=67 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 12:02:48.748605 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-b1b5b7d9-745e-4487-a498-a7206d4f0fe4 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 12:02:48.749794 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-b1b5b7d9-745e-4487-a498-a7206d4f0fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:02:48.757495 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 571/1152] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 12:02:48 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 12:02:49.029679 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1c9fe-55de-4b97-a81c-bd3420771b36 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:02:49.031344 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-4ea1c9fe-55de-4b97-a81c-bd3420771b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:02:49.097860 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1c9fe-55de-4b97-a81c-bd3420771b36 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:02:49.101510 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8862327b-a6b0-4423-adc5-f4b45ee20368 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c940de37d2d453c875d3ab6c077a331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:02:49.102149 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862327b-a6b0-4423-adc5-f4b45ee20368 service cinder] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:02:49.102433 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862327b-a6b0-4423-adc5-f4b45ee20368 service cinder] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:02:49.102713 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862327b-a6b0-4423-adc5-f4b45ee20368 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:02:49.111488 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8862327b-a6b0-4423-adc5-f4b45ee20368 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:02:49.112940 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8862327b-a6b0-4423-adc5-f4b45ee20368 service cinder] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:02:49.122599 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 582/1153] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 12:02:49 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 12:02:51.379833 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc20cac-3264-4956-add6-d41101980b90 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:02:51.380416 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc20cac-3264-4956-add6-d41101980b90 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:02:51.380416 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc20cac-3264-4956-add6-d41101980b90 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:02:51.381790 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 572/1154] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 12:02:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 12:02:51.387501 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63849b8c-e619-4b93-a347-99f82b901a32 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:02:51.387982 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63849b8c-e619-4b93-a347-99f82b901a32 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:02:51.388090 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63849b8c-e619-4b93-a347-99f82b901a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:02:51.405931 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-63849b8c-e619-4b93-a347-99f82b901a32 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 12:02:51.407125 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-63849b8c-e619-4b93-a347-99f82b901a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:02:51.414959 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 583/1155] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 12:02:51 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 12:02:51.685241 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc20cac-3264-4956-add6-d41101980b90 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:02:51.686904 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-bdc20cac-3264-4956-add6-d41101980b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:02:51.699539 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc20cac-3264-4956-add6-d41101980b90 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:02:51.702913 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d3753c-38ba-4c39-ab98-7486d371d1cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c940de37d2d453c875d3ab6c077a331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:02:51.703616 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3753c-38ba-4c39-ab98-7486d371d1cc service cinder] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:02:51.703933 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3753c-38ba-4c39-ab98-7486d371d1cc service cinder] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:02:51.704210 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3753c-38ba-4c39-ab98-7486d371d1cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:02:51.712830 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d3753c-38ba-4c39-ab98-7486d371d1cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:02:51.714238 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d3753c-38ba-4c39-ab98-7486d371d1cc service cinder] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:02:51.723388 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 573/1156] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 12:02:51 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 12:03:01.401151 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=75 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 12:03:01.719320 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=8 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 12:04:11.112916 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c8a418-485f-4f42-8519-a4a2885d14b2 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:04:11.113574 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c8a418-485f-4f42-8519-a4a2885d14b2 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:04:11.113574 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c8a418-485f-4f42-8519-a4a2885d14b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:04:11.117808 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f2ac9-6d9c-4f26-9d63-8b4354c618c0 None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:04:11.118296 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f2ac9-6d9c-4f26-9d63-8b4354c618c0 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:04:11.118399 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f2ac9-6d9c-4f26-9d63-8b4354c618c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:04:11.136751 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-da7f2ac9-6d9c-4f26-9d63-8b4354c618c0 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 12:04:11.137581 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-22c8a418-485f-4f42-8519-a4a2885d14b2 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 12:04:11.138211 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-da7f2ac9-6d9c-4f26-9d63-8b4354c618c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:04:11.138765 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-22c8a418-485f-4f42-8519-a4a2885d14b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:04:11.145934 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 574/1157] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 25 12:04:11 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 12:04:11.146502 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 584/1158] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 25 12:04:11 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 12:04:11.155339 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd81a82-4d7b-45f0-8e6a-c5188db006b6 None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:04:11.155628 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd81a82-4d7b-45f0-8e6a-c5188db006b6 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:04:11.155944 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727418a2-4692-40cd-a5b9-9de64787d712 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:04:11.156082 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd81a82-4d7b-45f0-8e6a-c5188db006b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:04:11.156264 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727418a2-4692-40cd-a5b9-9de64787d712 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:04:11.156518 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727418a2-4692-40cd-a5b9-9de64787d712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:04:11.173817 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-0cd81a82-4d7b-45f0-8e6a-c5188db006b6 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 12:04:11.174523 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-727418a2-4692-40cd-a5b9-9de64787d712 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 12:04:11.175004 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-0cd81a82-4d7b-45f0-8e6a-c5188db006b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:04:11.175693 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-727418a2-4692-40cd-a5b9-9de64787d712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:04:11.185539 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 575/1159] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 25 12:04:11 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 12:04:11.186652 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 585/1160] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 25 12:04:11 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 12:04:11.190383 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd81a82-4d7b-45f0-8e6a-c5188db006b6 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:04:11.190619 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727418a2-4692-40cd-a5b9-9de64787d712 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:04:11.200102 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727418a2-4692-40cd-a5b9-9de64787d712 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:04:11.200256 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd81a82-4d7b-45f0-8e6a-c5188db006b6 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:04:11.204632 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3a93d-7d96-4c94-9579-3510f9bde744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7103ef35356d4cd6a0f435bed6b1df47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:04:11.204775 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58732249-01f8-4e06-85ec-a654513eafb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7103ef35356d4cd6a0f435bed6b1df47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:04:11.205277 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3a93d-7d96-4c94-9579-3510f9bde744 admin admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:04:11.205381 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58732249-01f8-4e06-85ec-a654513eafb2 admin admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:04:11.205558 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58732249-01f8-4e06-85ec-a654513eafb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:04:11.205658 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3a93d-7d96-4c94-9579-3510f9bde744 admin admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:04:11.205836 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58732249-01f8-4e06-85ec-a654513eafb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:04:11.205941 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3a93d-7d96-4c94-9579-3510f9bde744 admin admin] PATH_INFO: `/v3/domains` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:04:11.206556 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c3a93d-7d96-4c94-9579-3510f9bde744 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86939) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 12:04:11.206657 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58732249-01f8-4e06-85ec-a654513eafb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86938) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 12:04:11.206861 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58732249-01f8-4e06-85ec-a654513eafb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:04:11.206968 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c3a93d-7d96-4c94-9579-3510f9bde744 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:04:11.207913 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: WARNING py.warnings [None req-58732249-01f8-4e06-85ec-a654513eafb2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 12:04:11.207913 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: warnings.warn(msg) May 25 12:04:11.207913 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: May 25 12:04:11.208518 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c3a93d-7d96-4c94-9579-3510f9bde744 admin admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:04:11.208797 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58732249-01f8-4e06-85ec-a654513eafb2 admin admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:04:11.220513 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 586/1161] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 25 12:04:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 12:04:11.224501 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 576/1162] 10.222.0.44 () {58 vars in 1152 bytes} [Wed May 25 12:04:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 12:04:11.228303 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3a93d-7d96-4c94-9579-3510f9bde744 admin admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:04:11.228701 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58732249-01f8-4e06-85ec-a654513eafb2 admin admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:04:11.237943 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3a93d-7d96-4c94-9579-3510f9bde744 admin admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:04:11.238129 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58732249-01f8-4e06-85ec-a654513eafb2 admin admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:04:11.242974 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d249f92a-fc21-4497-8b49-c88ee94a3ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7103ef35356d4cd6a0f435bed6b1df47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:04:11.243317 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926a0ce-006d-4777-badf-eec2895f2eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7103ef35356d4cd6a0f435bed6b1df47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:04:11.243601 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249f92a-fc21-4497-8b49-c88ee94a3ee6 admin admin] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:04:11.243921 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249f92a-fc21-4497-8b49-c88ee94a3ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:04:11.244031 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926a0ce-006d-4777-badf-eec2895f2eff admin admin] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:04:11.244203 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249f92a-fc21-4497-8b49-c88ee94a3ee6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:04:11.244311 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926a0ce-006d-4777-badf-eec2895f2eff admin admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:04:11.244509 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926a0ce-006d-4777-badf-eec2895f2eff admin admin] PATH_INFO: `/v3/projects` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:04:11.244906 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d249f92a-fc21-4497-8b49-c88ee94a3ee6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:04:11.245210 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d926a0ce-006d-4777-badf-eec2895f2eff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:04:11.245894 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: WARNING py.warnings [None req-d249f92a-fc21-4497-8b49-c88ee94a3ee6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 12:04:11.245894 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: warnings.warn(msg) May 25 12:04:11.245894 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: May 25 12:04:11.247066 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d926a0ce-006d-4777-badf-eec2895f2eff admin admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:04:11.247165 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d249f92a-fc21-4497-8b49-c88ee94a3ee6 admin admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:04:11.283077 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 577/1163] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 25 12:04:11 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 12:04:11.284956 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 587/1164] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 25 12:04:11 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 12:04:11.287423 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926a0ce-006d-4777-badf-eec2895f2eff admin admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:04:11.289155 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d249f92a-fc21-4497-8b49-c88ee94a3ee6 admin admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:04:11.348387 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926a0ce-006d-4777-badf-eec2895f2eff admin admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:04:11.349637 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d249f92a-fc21-4497-8b49-c88ee94a3ee6 admin admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:04:11.353077 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09533cb-8523-430b-af21-4ab9eebe5bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7103ef35356d4cd6a0f435bed6b1df47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:04:11.353742 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09533cb-8523-430b-af21-4ab9eebe5bea admin admin] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:04:11.354027 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09533cb-8523-430b-af21-4ab9eebe5bea admin admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:04:11.354205 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a7ec1b-dea0-4ae4-a81c-63d23ec0b8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7103ef35356d4cd6a0f435bed6b1df47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:04:11.354322 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09533cb-8523-430b-af21-4ab9eebe5bea admin admin] PATH_INFO: `/v3/users` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:04:11.354867 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7ec1b-dea0-4ae4-a81c-63d23ec0b8a0 admin admin] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:04:11.355066 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09533cb-8523-430b-af21-4ab9eebe5bea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:04:11.355166 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7ec1b-dea0-4ae4-a81c-63d23ec0b8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:04:11.355418 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7ec1b-dea0-4ae4-a81c-63d23ec0b8a0 admin admin] PATH_INFO: `/v3/users` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:04:11.356039 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: WARNING py.warnings [None req-f09533cb-8523-430b-af21-4ab9eebe5bea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 12:04:11.356039 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: warnings.warn(msg) May 25 12:04:11.356039 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: May 25 12:04:11.356291 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a7ec1b-dea0-4ae4-a81c-63d23ec0b8a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:04:11.357261 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09533cb-8523-430b-af21-4ab9eebe5bea admin admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:04:11.358038 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a7ec1b-dea0-4ae4-a81c-63d23ec0b8a0 admin admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:04:11.377021 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 578/1165] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 25 12:04:11 2022] POST /identity/v3/users => generated 290 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 12:04:11.378584 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 588/1166] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 25 12:04:11 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 12:04:11.380937 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09533cb-8523-430b-af21-4ab9eebe5bea admin admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:04:11.382294 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a7ec1b-dea0-4ae4-a81c-63d23ec0b8a0 admin admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:04:11.391722 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09533cb-8523-430b-af21-4ab9eebe5bea admin admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:04:11.392946 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a7ec1b-dea0-4ae4-a81c-63d23ec0b8a0 admin admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:04:11.396362 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d5a81f-35ae-4369-9701-20a59f87181f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7103ef35356d4cd6a0f435bed6b1df47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:04:11.397008 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5a81f-35ae-4369-9701-20a59f87181f admin admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:04:11.397290 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5a81f-35ae-4369-9701-20a59f87181f admin admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:04:11.397567 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5a81f-35ae-4369-9701-20a59f87181f admin admin] PATH_INFO: `/v3/roles` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:04:11.397683 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f475af-2dec-409d-bbfa-cd0e375a4868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7103ef35356d4cd6a0f435bed6b1df47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:04:11.398272 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f475af-2dec-409d-bbfa-cd0e375a4868 admin admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:04:11.398450 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d5a81f-35ae-4369-9701-20a59f87181f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:04:11.398555 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f475af-2dec-409d-bbfa-cd0e375a4868 admin admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:04:11.398823 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f475af-2dec-409d-bbfa-cd0e375a4868 admin admin] PATH_INFO: `/v3/roles` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:04:11.399533 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f475af-2dec-409d-bbfa-cd0e375a4868 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:04:11.399902 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d5a81f-35ae-4369-9701-20a59f87181f admin admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:04:11.401159 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f475af-2dec-409d-bbfa-cd0e375a4868 admin admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:04:11.413712 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 579/1167] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 25 12:04:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 12:04:11.417604 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d5a81f-35ae-4369-9701-20a59f87181f admin admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:04:11.422965 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 589/1168] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 25 12:04:11 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 12:04:11.427347 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d5a81f-35ae-4369-9701-20a59f87181f admin admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:04:11.430416 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f475af-2dec-409d-bbfa-cd0e375a4868 admin admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:04:11.432503 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da145b4-b053-436b-9795-929d91fbfaa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7103ef35356d4cd6a0f435bed6b1df47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:04:11.433153 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da145b4-b053-436b-9795-929d91fbfaa1 admin admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:04:11.433434 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da145b4-b053-436b-9795-929d91fbfaa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:04:11.433707 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da145b4-b053-436b-9795-929d91fbfaa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:04:11.434420 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da145b4-b053-436b-9795-929d91fbfaa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:04:11.436255 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da145b4-b053-436b-9795-929d91fbfaa1 admin admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:04:11.440218 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f475af-2dec-409d-bbfa-cd0e375a4868 admin admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:04:11.444879 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d423d5e8-0daa-43e6-a86f-556123d8ab64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7103ef35356d4cd6a0f435bed6b1df47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:04:11.446099 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423d5e8-0daa-43e6-a86f-556123d8ab64 admin admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:04:11.446383 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423d5e8-0daa-43e6-a86f-556123d8ab64 admin admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:04:11.446662 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423d5e8-0daa-43e6-a86f-556123d8ab64 admin admin] PATH_INFO: `/v3/roles` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:04:11.446763 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 580/1169] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 25 12:04:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 12:04:11.447382 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d423d5e8-0daa-43e6-a86f-556123d8ab64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:04:11.449063 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d423d5e8-0daa-43e6-a86f-556123d8ab64 admin admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:04:11.450642 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da145b4-b053-436b-9795-929d91fbfaa1 admin admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:04:11.463312 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 590/1170] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 25 12:04:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 12:04:11.463490 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da145b4-b053-436b-9795-929d91fbfaa1 admin admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:04:11.464627 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d423d5e8-0daa-43e6-a86f-556123d8ab64 admin admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:04:11.465609 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d701e6c5-4352-45e6-afce-9db9e6aae5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7103ef35356d4cd6a0f435bed6b1df47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:04:11.466479 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701e6c5-4352-45e6-afce-9db9e6aae5c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:04:11.466761 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701e6c5-4352-45e6-afce-9db9e6aae5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:04:11.467036 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701e6c5-4352-45e6-afce-9db9e6aae5c8 admin admin] PATH_INFO: `/v3/projects/5d5b817680ec402db3018aefe57ebc8f/users/4ddf921eab624adea9f4c25e3cda2125/roles/0bb7b8a3ae8f4d03a7f575ca8904963c` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:04:11.473885 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d423d5e8-0daa-43e6-a86f-556123d8ab64 admin admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:04:11.479141 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e8914-8a8b-420f-a056-5a48b830af2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7103ef35356d4cd6a0f435bed6b1df47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:04:11.480028 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e8914-8a8b-420f-a056-5a48b830af2d admin admin] REQUEST_METHOD: `PUT` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:04:11.480312 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e8914-8a8b-420f-a056-5a48b830af2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:04:11.480592 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e8914-8a8b-420f-a056-5a48b830af2d admin admin] PATH_INFO: `/v3/projects/516650671d6e40f3a7e8b14dceaa2be5/users/d1cd7766bc474a8692431e314e7e4d1b/roles/0bb7b8a3ae8f4d03a7f575ca8904963c` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:04:11.482586 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d701e6c5-4352-45e6-afce-9db9e6aae5c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d5b817680ec402db3018aefe57ebc8f, user_id=4ddf921eab624adea9f4c25e3cda2125, role_id=0bb7b8a3ae8f4d03a7f575ca8904963c)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:04:11.485277 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d701e6c5-4352-45e6-afce-9db9e6aae5c8 admin admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:04:11.497462 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0e8914-8a8b-420f-a056-5a48b830af2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=516650671d6e40f3a7e8b14dceaa2be5, user_id=d1cd7766bc474a8692431e314e7e4d1b, role_id=0bb7b8a3ae8f4d03a7f575ca8904963c)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:04:11.498530 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: WARNING py.warnings [None req-4d0e8914-8a8b-420f-a056-5a48b830af2d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 12:04:11.498530 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: warnings.warn(msg) May 25 12:04:11.498530 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: May 25 12:04:11.499748 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 581/1171] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 25 12:04:11 2022] PUT /identity/v3/projects/5d5b817680ec402db3018aefe57ebc8f/users/4ddf921eab624adea9f4c25e3cda2125/roles/0bb7b8a3ae8f4d03a7f575ca8904963c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 12:04:11.503370 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0e8914-8a8b-420f-a056-5a48b830af2d admin admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:04:11.504775 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d80b53-1934-4337-92e3-08a2983656a5 None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:04:11.505225 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d80b53-1934-4337-92e3-08a2983656a5 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:04:11.505626 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d80b53-1934-4337-92e3-08a2983656a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:04:11.514452 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 591/1172] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 25 12:04:11 2022] PUT /identity/v3/projects/516650671d6e40f3a7e8b14dceaa2be5/users/d1cd7766bc474a8692431e314e7e4d1b/roles/0bb7b8a3ae8f4d03a7f575ca8904963c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 12:04:11.519357 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a592584-68bc-4769-9648-42b4165450e5 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:04:11.519881 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a592584-68bc-4769-9648-42b4165450e5 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:04:11.520168 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a592584-68bc-4769-9648-42b4165450e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:04:11.523288 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-03d80b53-1934-4337-92e3-08a2983656a5 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 12:04:11.525020 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-03d80b53-1934-4337-92e3-08a2983656a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:04:11.537996 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-9a592584-68bc-4769-9648-42b4165450e5 None None] MFA Rules not processed for user `c3f509c203864ee381a0b9ac7112de28`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 12:04:11.539819 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-9a592584-68bc-4769-9648-42b4165450e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:04:11.565874 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 12:04:11.580548 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 12:04:11.584895 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 582/1173] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 25 12:04:11 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 12:04:11.595559 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d80b53-1934-4337-92e3-08a2983656a5 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:04:11.600391 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 592/1174] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 25 12:04:11 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 12:04:11.610366 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a592584-68bc-4769-9648-42b4165450e5 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:04:11.649338 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d80b53-1934-4337-92e3-08a2983656a5 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:04:11.653780 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec3153-0ff2-4b54-a367-f096b3dd6935 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be63af25271b49b5903e8fe66a62b1d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:04:11.654424 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec3153-0ff2-4b54-a367-f096b3dd6935 service neutron] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:04:11.654711 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec3153-0ff2-4b54-a367-f096b3dd6935 service neutron] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:04:11.654979 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec3153-0ff2-4b54-a367-f096b3dd6935 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:04:11.663238 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a592584-68bc-4769-9648-42b4165450e5 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:04:11.663876 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ec3153-0ff2-4b54-a367-f096b3dd6935 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:04:11.665816 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ec3153-0ff2-4b54-a367-f096b3dd6935 service neutron] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:04:11.667475 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f2fb07-3f58-4edc-8d2c-ea566a4d00b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be63af25271b49b5903e8fe66a62b1d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:04:11.668140 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f2fb07-3f58-4edc-8d2c-ea566a4d00b7 service neutron] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:04:11.668428 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f2fb07-3f58-4edc-8d2c-ea566a4d00b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:04:11.668707 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f2fb07-3f58-4edc-8d2c-ea566a4d00b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:04:11.674974 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 583/1175] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 12:04:11 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 12:04:11.677727 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f2fb07-3f58-4edc-8d2c-ea566a4d00b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:04:11.679228 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f2fb07-3f58-4edc-8d2c-ea566a4d00b7 service neutron] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:04:11.689433 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 593/1176] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 12:04:11 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 12:04:16.760208 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9b574-7cae-406c-adf1-930b32816a8b None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:04:16.760829 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9b574-7cae-406c-adf1-930b32816a8b None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:04:16.760939 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9b574-7cae-406c-adf1-930b32816a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:04:16.826231 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-16e9b574-7cae-406c-adf1-930b32816a8b None None] MFA Rules not processed for user `d1cd7766bc474a8692431e314e7e4d1b`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 12:04:16.827477 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-16e9b574-7cae-406c-adf1-930b32816a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:04:16.977463 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 584/1177] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 25 12:04:16 2022] POST /identity/v3/auth/tokens => generated 2812 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 12:04:16.979290 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f2fb07-3f58-4edc-8d2c-ea566a4d00b7 service neutron] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:04:16.992887 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f2fb07-3f58-4edc-8d2c-ea566a4d00b7 service neutron] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:04:17.012607 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff714b43-5c50-4b62-8546-e701c546b3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7103ef35356d4cd6a0f435bed6b1df47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:04:17.013311 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff714b43-5c50-4b62-8546-e701c546b3fc admin admin] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:04:17.013592 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff714b43-5c50-4b62-8546-e701c546b3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:04:17.013927 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff714b43-5c50-4b62-8546-e701c546b3fc admin admin] PATH_INFO: `/v3/projects` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:04:17.014551 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff714b43-5c50-4b62-8546-e701c546b3fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:04:17.016528 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff714b43-5c50-4b62-8546-e701c546b3fc admin admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:04:17.079567 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 594/1178] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 25 12:04:16 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 12:04:17.080750 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e9b574-7cae-406c-adf1-930b32816a8b None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:04:17.103826 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e31c667-bb5b-4e2c-93c2-3e9c926dfff4 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:04:17.104219 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e31c667-bb5b-4e2c-93c2-3e9c926dfff4 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:04:17.104666 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e31c667-bb5b-4e2c-93c2-3e9c926dfff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:04:17.105386 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e9b574-7cae-406c-adf1-930b32816a8b None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:04:17.140997 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-6e31c667-bb5b-4e2c-93c2-3e9c926dfff4 None None] MFA Rules not processed for user `4ddf921eab624adea9f4c25e3cda2125`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 12:04:17.144138 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-6e31c667-bb5b-4e2c-93c2-3e9c926dfff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:04:17.216273 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fcb2c8-507d-4070-a93f-7d3523a110d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7103ef35356d4cd6a0f435bed6b1df47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:04:17.216967 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcb2c8-507d-4070-a93f-7d3523a110d9 admin admin] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:04:17.217378 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcb2c8-507d-4070-a93f-7d3523a110d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:04:17.217671 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcb2c8-507d-4070-a93f-7d3523a110d9 admin admin] PATH_INFO: `/v3/users` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:04:17.218383 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fcb2c8-507d-4070-a93f-7d3523a110d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:04:17.220604 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fcb2c8-507d-4070-a93f-7d3523a110d9 admin admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:04:17.254237 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 585/1179] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 25 12:04:17 2022] POST /identity/v3/users => generated 298 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 12:04:17.256583 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 595/1180] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 25 12:04:17 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 12:04:17.257158 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fcb2c8-507d-4070-a93f-7d3523a110d9 admin admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:04:17.263072 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e31c667-bb5b-4e2c-93c2-3e9c926dfff4 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:04:17.269963 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fcb2c8-507d-4070-a93f-7d3523a110d9 admin admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:04:17.275009 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2bcb87-03ca-483d-8b3d-b1b85d9d29c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7103ef35356d4cd6a0f435bed6b1df47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:04:17.275695 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2bcb87-03ca-483d-8b3d-b1b85d9d29c8 admin admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:04:17.276013 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2bcb87-03ca-483d-8b3d-b1b85d9d29c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:04:17.276291 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2bcb87-03ca-483d-8b3d-b1b85d9d29c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:04:17.277018 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2bcb87-03ca-483d-8b3d-b1b85d9d29c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:04:17.278629 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2bcb87-03ca-483d-8b3d-b1b85d9d29c8 admin admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:04:17.280461 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e31c667-bb5b-4e2c-93c2-3e9c926dfff4 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:04:17.281287 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 12:04:17.292524 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b68c9-95d0-4748-be9b-3191f7e38604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7103ef35356d4cd6a0f435bed6b1df47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:04:17.293199 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b68c9-95d0-4748-be9b-3191f7e38604 admin admin] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:04:17.293482 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b68c9-95d0-4748-be9b-3191f7e38604 admin admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:04:17.293762 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b68c9-95d0-4748-be9b-3191f7e38604 admin admin] PATH_INFO: `/v3/projects` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:04:17.294455 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b68c9-95d0-4748-be9b-3191f7e38604 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:04:17.296498 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b68c9-95d0-4748-be9b-3191f7e38604 admin admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:04:17.297450 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 586/1181] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 25 12:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 12:04:17.301256 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2bcb87-03ca-483d-8b3d-b1b85d9d29c8 admin admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:04:17.323250 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2bcb87-03ca-483d-8b3d-b1b85d9d29c8 admin admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:04:17.331209 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b3e98-c449-4c1e-a79a-a6a7527c4b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7103ef35356d4cd6a0f435bed6b1df47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:04:17.332255 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b3e98-c449-4c1e-a79a-a6a7527c4b7c admin admin] REQUEST_METHOD: `PUT` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:04:17.332552 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b3e98-c449-4c1e-a79a-a6a7527c4b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:04:17.332925 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b3e98-c449-4c1e-a79a-a6a7527c4b7c admin admin] PATH_INFO: `/v3/projects/47bd8d60f015447b8f2f0d159e073f18/users/140c36f8f35d4ae89e2785e0d0c65ac9/roles/2fe5c1214bcc4c1bafa5a4545161518d` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:04:17.336328 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 596/1182] 10.222.0.44 () {60 vars in 1152 bytes} [Wed May 25 12:04:17 2022] POST /identity/v3/projects => generated 379 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 12:04:17.340301 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b68c9-95d0-4748-be9b-3191f7e38604 admin admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:04:17.360100 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8b3e98-c449-4c1e-a79a-a6a7527c4b7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=47bd8d60f015447b8f2f0d159e073f18, user_id=140c36f8f35d4ae89e2785e0d0c65ac9, role_id=2fe5c1214bcc4c1bafa5a4545161518d)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:04:17.363013 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8b3e98-c449-4c1e-a79a-a6a7527c4b7c admin admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:04:17.384443 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 587/1183] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 25 12:04:17 2022] PUT /identity/v3/projects/47bd8d60f015447b8f2f0d159e073f18/users/140c36f8f35d4ae89e2785e0d0c65ac9/roles/2fe5c1214bcc4c1bafa5a4545161518d => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 12:04:17.386603 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b3e98-c449-4c1e-a79a-a6a7527c4b7c admin admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:04:17.392496 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 12:04:17.423129 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b68c9-95d0-4748-be9b-3191f7e38604 admin admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:04:17.461510 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b3e98-c449-4c1e-a79a-a6a7527c4b7c admin admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:04:17.466743 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be23b0d-8d70-464a-9f33-55a33224d0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7103ef35356d4cd6a0f435bed6b1df47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:04:17.467426 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be23b0d-8d70-464a-9f33-55a33224d0a0 admin admin] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:04:17.467713 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be23b0d-8d70-464a-9f33-55a33224d0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:04:17.468026 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be23b0d-8d70-464a-9f33-55a33224d0a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:04:17.468764 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be23b0d-8d70-464a-9f33-55a33224d0a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:04:17.470396 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be23b0d-8d70-464a-9f33-55a33224d0a0 admin admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:04:17.480682 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 588/1184] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 25 12:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 12:04:17.486178 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be23b0d-8d70-464a-9f33-55a33224d0a0 admin admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:04:17.495497 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7634fd7f-2c02-4433-8d6d-16a21beb2f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7103ef35356d4cd6a0f435bed6b1df47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:04:17.496126 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634fd7f-2c02-4433-8d6d-16a21beb2f34 admin admin] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:04:17.496450 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634fd7f-2c02-4433-8d6d-16a21beb2f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:04:17.496691 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634fd7f-2c02-4433-8d6d-16a21beb2f34 admin admin] PATH_INFO: `/v3/users` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:04:17.497391 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7634fd7f-2c02-4433-8d6d-16a21beb2f34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:04:17.498144 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be23b0d-8d70-464a-9f33-55a33224d0a0 admin admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:04:17.499336 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7634fd7f-2c02-4433-8d6d-16a21beb2f34 admin admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:04:17.505776 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c096f63-c248-4c99-b671-0f2065bc84f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7103ef35356d4cd6a0f435bed6b1df47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:04:17.506405 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c096f63-c248-4c99-b671-0f2065bc84f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:04:17.506704 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c096f63-c248-4c99-b671-0f2065bc84f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:04:17.507051 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c096f63-c248-4c99-b671-0f2065bc84f6 admin admin] PATH_INFO: `/v3/projects/47bd8d60f015447b8f2f0d159e073f18/users/140c36f8f35d4ae89e2785e0d0c65ac9/roles/2fe5c1214bcc4c1bafa5a4545161518d` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:04:17.511026 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c096f63-c248-4c99-b671-0f2065bc84f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47bd8d60f015447b8f2f0d159e073f18, user_id=140c36f8f35d4ae89e2785e0d0c65ac9, role_id=2fe5c1214bcc4c1bafa5a4545161518d)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:04:17.514530 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c096f63-c248-4c99-b671-0f2065bc84f6 admin admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:04:17.523784 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 597/1185] 10.222.0.44 () {60 vars in 1143 bytes} [Wed May 25 12:04:17 2022] POST /identity/v3/users => generated 296 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 12:04:17.527424 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7634fd7f-2c02-4433-8d6d-16a21beb2f34 admin admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:04:17.531867 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 589/1186] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 25 12:04:17 2022] PUT /identity/v3/projects/47bd8d60f015447b8f2f0d159e073f18/users/140c36f8f35d4ae89e2785e0d0c65ac9/roles/2fe5c1214bcc4c1bafa5a4545161518d => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 12:04:17.540710 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7634fd7f-2c02-4433-8d6d-16a21beb2f34 admin admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:04:17.623716 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f2d5a-ba0e-4029-b514-5585c625b814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7103ef35356d4cd6a0f435bed6b1df47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:04:17.624555 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f2d5a-ba0e-4029-b514-5585c625b814 admin admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:04:17.625002 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f2d5a-ba0e-4029-b514-5585c625b814 admin admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:04:17.625349 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f2d5a-ba0e-4029-b514-5585c625b814 admin admin] PATH_INFO: `/v3/roles` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:04:17.626498 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9f2d5a-ba0e-4029-b514-5585c625b814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:04:17.628637 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9f2d5a-ba0e-4029-b514-5585c625b814 admin admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:04:17.646396 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 598/1187] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 25 12:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 12:04:17.651070 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c096f63-c248-4c99-b671-0f2065bc84f6 admin admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:04:17.668566 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c096f63-c248-4c99-b671-0f2065bc84f6 admin admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:04:17.680571 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2733132c-bf14-43f4-8be1-72cd934254c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7103ef35356d4cd6a0f435bed6b1df47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:04:17.683863 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2733132c-bf14-43f4-8be1-72cd934254c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:04:17.683863 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2733132c-bf14-43f4-8be1-72cd934254c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:04:17.683863 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2733132c-bf14-43f4-8be1-72cd934254c8 admin admin] PATH_INFO: `/v3/projects/acc590f5e80e41469cebbdadac7dde76/users/b8b4456c32a64e7e88e6efb5dc2e8a97/roles/2fe5c1214bcc4c1bafa5a4545161518d` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:04:17.708766 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2733132c-bf14-43f4-8be1-72cd934254c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acc590f5e80e41469cebbdadac7dde76, user_id=b8b4456c32a64e7e88e6efb5dc2e8a97, role_id=2fe5c1214bcc4c1bafa5a4545161518d)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:04:17.712484 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2733132c-bf14-43f4-8be1-72cd934254c8 admin admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:04:17.748551 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 590/1188] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 25 12:04:17 2022] PUT /identity/v3/projects/acc590f5e80e41469cebbdadac7dde76/users/b8b4456c32a64e7e88e6efb5dc2e8a97/roles/2fe5c1214bcc4c1bafa5a4545161518d => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 12:04:17.750322 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f2d5a-ba0e-4029-b514-5585c625b814 admin admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:04:17.767969 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f2d5a-ba0e-4029-b514-5585c625b814 admin admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:04:17.870621 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf29e8-eb30-4fd3-bd69-674a11cb2967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7103ef35356d4cd6a0f435bed6b1df47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:04:17.871299 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf29e8-eb30-4fd3-bd69-674a11cb2967 admin admin] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:04:17.871586 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf29e8-eb30-4fd3-bd69-674a11cb2967 admin admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:04:17.871919 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf29e8-eb30-4fd3-bd69-674a11cb2967 admin admin] PATH_INFO: `/v3/roles` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:04:17.872649 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf29e8-eb30-4fd3-bd69-674a11cb2967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:04:17.874272 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf29e8-eb30-4fd3-bd69-674a11cb2967 admin admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:04:17.889381 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 599/1189] 10.222.0.44 () {58 vars in 1121 bytes} [Wed May 25 12:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 12:04:17.890850 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2733132c-bf14-43f4-8be1-72cd934254c8 admin admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:04:17.903127 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2733132c-bf14-43f4-8be1-72cd934254c8 admin admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:04:17.910302 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3786eb9-0618-448b-9aa3-5bbd869baa3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7103ef35356d4cd6a0f435bed6b1df47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:04:17.911269 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3786eb9-0618-448b-9aa3-5bbd869baa3a admin admin] REQUEST_METHOD: `PUT` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:04:17.912376 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3786eb9-0618-448b-9aa3-5bbd869baa3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:04:17.912620 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3786eb9-0618-448b-9aa3-5bbd869baa3a admin admin] PATH_INFO: `/v3/projects/acc590f5e80e41469cebbdadac7dde76/users/b8b4456c32a64e7e88e6efb5dc2e8a97/roles/2fe5c1214bcc4c1bafa5a4545161518d` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:04:17.915321 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3786eb9-0618-448b-9aa3-5bbd869baa3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=acc590f5e80e41469cebbdadac7dde76, user_id=b8b4456c32a64e7e88e6efb5dc2e8a97, role_id=2fe5c1214bcc4c1bafa5a4545161518d)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:04:17.918117 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3786eb9-0618-448b-9aa3-5bbd869baa3a admin admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:04:17.930446 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 591/1190] 10.222.0.44 () {60 vars in 1482 bytes} [Wed May 25 12:04:17 2022] PUT /identity/v3/projects/acc590f5e80e41469cebbdadac7dde76/users/b8b4456c32a64e7e88e6efb5dc2e8a97/roles/2fe5c1214bcc4c1bafa5a4545161518d => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 12:04:23.899733 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e1704-7cc7-48db-8290-9c41d0b52e52 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:04:23.900380 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e1704-7cc7-48db-8290-9c41d0b52e52 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:04:23.900592 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e1704-7cc7-48db-8290-9c41d0b52e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:04:23.917685 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 12:04:23.941552 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-e67e1704-7cc7-48db-8290-9c41d0b52e52 None None] MFA Rules not processed for user `140c36f8f35d4ae89e2785e0d0c65ac9`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 12:04:23.942799 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-e67e1704-7cc7-48db-8290-9c41d0b52e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:04:24.147846 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 600/1191] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 25 12:04:23 2022] POST /identity/v3/auth/tokens => generated 2877 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 12:04:24.160338 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3786eb9-0618-448b-9aa3-5bbd869baa3a admin admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:04:24.163408 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-f3786eb9-0618-448b-9aa3-5bbd869baa3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:04:24.238401 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6fef6-fb02-4bce-8b65-5959af4f2309 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:04:24.238950 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6fef6-fb02-4bce-8b65-5959af4f2309 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:04:24.239411 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6fef6-fb02-4bce-8b65-5959af4f2309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:04:24.302576 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-98f6fef6-fb02-4bce-8b65-5959af4f2309 None None] MFA Rules not processed for user `b8b4456c32a64e7e88e6efb5dc2e8a97`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 12:04:24.304671 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-98f6fef6-fb02-4bce-8b65-5959af4f2309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:04:24.373181 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3786eb9-0618-448b-9aa3-5bbd869baa3a admin admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:04:24.377631 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4114338-2885-4ab7-96e7-90055c2e8541 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bda1409f24a24f51b42043933e30a560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:04:24.378477 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4114338-2885-4ab7-96e7-90055c2e8541 service glance] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:04:24.378875 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4114338-2885-4ab7-96e7-90055c2e8541 service glance] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:04:24.379367 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4114338-2885-4ab7-96e7-90055c2e8541 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:04:24.408997 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 12:04:24.461128 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 601/1192] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 25 12:04:24 2022] POST /identity/v3/auth/tokens => generated 2873 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 12:04:24.471138 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f6fef6-fb02-4bce-8b65-5959af4f2309 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:04:24.473156 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-98f6fef6-fb02-4bce-8b65-5959af4f2309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:04:24.475338 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4114338-2885-4ab7-96e7-90055c2e8541 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:04:24.477686 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4114338-2885-4ab7-96e7-90055c2e8541 service glance] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:04:24.498811 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f6fef6-fb02-4bce-8b65-5959af4f2309 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:04:24.504411 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b19ea69-ea8f-4e38-b431-53d6fe86c8a1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bda1409f24a24f51b42043933e30a560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:04:24.505865 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19ea69-ea8f-4e38-b431-53d6fe86c8a1 service glance] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:04:24.506341 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19ea69-ea8f-4e38-b431-53d6fe86c8a1 service glance] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:04:24.506515 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 592/1193] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 12:04:24 2022] GET /identity/v3/auth/tokens => generated 2812 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 12:04:24.506645 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19ea69-ea8f-4e38-b431-53d6fe86c8a1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:04:24.618253 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b19ea69-ea8f-4e38-b431-53d6fe86c8a1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:04:24.621780 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b19ea69-ea8f-4e38-b431-53d6fe86c8a1 service glance] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:04:24.638070 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 602/1194] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 12:04:24 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 12:04:32.894202 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd372c89-86c3-4fc6-9ab0-355d72d9c44a None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:04:32.895378 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd372c89-86c3-4fc6-9ab0-355d72d9c44a None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:04:32.895666 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd372c89-86c3-4fc6-9ab0-355d72d9c44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:04:32.919864 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-dd372c89-86c3-4fc6-9ab0-355d72d9c44a None None] MFA Rules not processed for user `d1cd7766bc474a8692431e314e7e4d1b`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 12:04:32.921635 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-dd372c89-86c3-4fc6-9ab0-355d72d9c44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:04:32.932828 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 593/1195] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 25 12:04:32 2022] POST /identity/v3/auth/tokens => generated 2812 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 12:04:33.239216 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a3f74-7e16-4498-a7a6-cc4ece1a1048 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:04:33.239788 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a3f74-7e16-4498-a7a6-cc4ece1a1048 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:04:33.240013 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a3f74-7e16-4498-a7a6-cc4ece1a1048 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:04:33.242072 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 603/1196] 10.222.0.44 () {54 vars in 961 bytes} [Wed May 25 12:04:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 12:04:33.248936 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb28ea-2108-499e-b6ab-8182c8d76f2c None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:04:33.249414 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb28ea-2108-499e-b6ab-8182c8d76f2c None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:04:33.249772 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb28ea-2108-499e-b6ab-8182c8d76f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:04:33.286603 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-95fb28ea-2108-499e-b6ab-8182c8d76f2c None None] MFA Rules not processed for user `d25d7a439361492d8d7ba018531a2e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 12:04:33.289380 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-95fb28ea-2108-499e-b6ab-8182c8d76f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:04:33.367884 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 594/1197] 10.222.0.44 () {58 vars in 1058 bytes} [Wed May 25 12:04:33 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 12:04:33.373802 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a2098a-24b7-4894-82ce-4bb0441f3a53 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:04:33.374210 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a2098a-24b7-4894-82ce-4bb0441f3a53 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:04:33.374604 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a2098a-24b7-4894-82ce-4bb0441f3a53 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:04:33.379322 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 604/1198] 10.222.0.44 () {54 vars in 912 bytes} [Wed May 25 12:04:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 12:04:33.383621 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4f2a8-3666-4167-b683-5a15d062b0fc None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:04:33.386863 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4f2a8-3666-4167-b683-5a15d062b0fc None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:04:33.387157 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4f2a8-3666-4167-b683-5a15d062b0fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:04:33.407317 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-a3a4f2a8-3666-4167-b683-5a15d062b0fc None None] MFA Rules not processed for user `d25d7a439361492d8d7ba018531a2e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 12:04:33.409182 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-a3a4f2a8-3666-4167-b683-5a15d062b0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:04:33.423963 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 595/1199] 10.222.0.44 () {58 vars in 1009 bytes} [Wed May 25 12:04:33 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 12:04:33.435100 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a2098a-24b7-4894-82ce-4bb0441f3a53 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:04:33.448759 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a2098a-24b7-4894-82ce-4bb0441f3a53 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:04:33.454827 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6995e7-dcab-4425-a588-4bff5313cac3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bda1409f24a24f51b42043933e30a560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:04:33.455476 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6995e7-dcab-4425-a588-4bff5313cac3 service glance] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:04:33.455755 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6995e7-dcab-4425-a588-4bff5313cac3 service glance] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:04:33.456061 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6995e7-dcab-4425-a588-4bff5313cac3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:04:33.467310 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6995e7-dcab-4425-a588-4bff5313cac3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:04:33.468946 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6995e7-dcab-4425-a588-4bff5313cac3 service glance] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:04:33.474702 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=100 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 12:04:33.484399 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 605/1200] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 12:04:33 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 12:04:33.901163 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa87dd81-b680-4898-8155-faf19495e617 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:04:33.901711 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa87dd81-b680-4898-8155-faf19495e617 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:04:33.908298 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa87dd81-b680-4898-8155-faf19495e617 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:04:33.910657 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 596/1201] 10.222.0.44 () {54 vars in 912 bytes} [Wed May 25 12:04:33 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 12:04:33.932134 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d076d9-ea95-4af4-9afb-4daa68f1d72a None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:04:33.932563 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d076d9-ea95-4af4-9afb-4daa68f1d72a None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:04:33.932948 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d076d9-ea95-4af4-9afb-4daa68f1d72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:04:34.017284 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-e7d076d9-ea95-4af4-9afb-4daa68f1d72a None None] MFA Rules not processed for user `be63af25271b49b5903e8fe66a62b1d2`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 12:04:34.019673 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-e7d076d9-ea95-4af4-9afb-4daa68f1d72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:04:34.180912 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 606/1202] 10.222.0.44 () {58 vars in 1009 bytes} [Wed May 25 12:04:33 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 12:04:34.185502 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa87dd81-b680-4898-8155-faf19495e617 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:04:34.188854 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-fa87dd81-b680-4898-8155-faf19495e617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:04:34.207562 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa87dd81-b680-4898-8155-faf19495e617 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:04:34.211188 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bf2c76-fa43-4ac4-bb28-641ffdf6577d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be63af25271b49b5903e8fe66a62b1d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:04:34.212468 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf2c76-fa43-4ac4-bb28-641ffdf6577d service neutron] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:04:34.212468 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf2c76-fa43-4ac4-bb28-641ffdf6577d service neutron] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:04:34.212718 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf2c76-fa43-4ac4-bb28-641ffdf6577d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:04:34.220782 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bf2c76-fa43-4ac4-bb28-641ffdf6577d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:04:34.222648 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bf2c76-fa43-4ac4-bb28-641ffdf6577d service neutron] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:04:34.257064 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 597/1203] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 12:04:34 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 12:04:34.756058 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47c1e8-1cea-48da-9f00-7f7baeb7c039 None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:04:34.756556 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47c1e8-1cea-48da-9f00-7f7baeb7c039 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:04:34.756666 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47c1e8-1cea-48da-9f00-7f7baeb7c039 None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:04:34.758173 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 607/1204] 10.222.0.44 () {54 vars in 961 bytes} [Wed May 25 12:04:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 12:04:34.764517 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad9e50-c6e8-4f18-90d0-3a7d6056b6b3 None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:04:34.764809 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad9e50-c6e8-4f18-90d0-3a7d6056b6b3 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:04:34.765087 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad9e50-c6e8-4f18-90d0-3a7d6056b6b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:04:34.827435 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-afad9e50-c6e8-4f18-90d0-3a7d6056b6b3 None None] MFA Rules not processed for user `d25d7a439361492d8d7ba018531a2e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 12:04:34.828738 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-afad9e50-c6e8-4f18-90d0-3a7d6056b6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:04:34.839101 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0cac8-e821-466b-8e68-ae9d93664a2b None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:04:34.839519 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0cac8-e821-466b-8e68-ae9d93664a2b None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:04:34.840080 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0cac8-e821-466b-8e68-ae9d93664a2b None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:04:34.842266 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 608/1205] 10.222.0.44 () {54 vars in 960 bytes} [Wed May 25 12:04:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 12:04:34.848255 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353282ee-0848-4202-b010-6cd3ef0b1b90 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:04:34.848492 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353282ee-0848-4202-b010-6cd3ef0b1b90 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:04:34.848761 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353282ee-0848-4202-b010-6cd3ef0b1b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:04:34.854596 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 598/1206] 10.222.0.44 () {58 vars in 1058 bytes} [Wed May 25 12:04:34 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 12:04:34.861283 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30b83f-51ac-4f67-825d-c94f64f4e6ee None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:04:34.862900 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30b83f-51ac-4f67-825d-c94f64f4e6ee None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:04:34.863297 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30b83f-51ac-4f67-825d-c94f64f4e6ee None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:04:34.865174 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 599/1207] 10.222.0.44 () {54 vars in 912 bytes} [Wed May 25 12:04:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 12:04:34.874727 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-353282ee-0848-4202-b010-6cd3ef0b1b90 None None] MFA Rules not processed for user `94f4a0c602a7495dbb36dd768cc55a47`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 12:04:34.877249 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea421a-f342-45a1-8cec-99ef1b61d448 None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:04:34.877674 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea421a-f342-45a1-8cec-99ef1b61d448 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:04:34.878061 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea421a-f342-45a1-8cec-99ef1b61d448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:04:34.880521 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-353282ee-0848-4202-b010-6cd3ef0b1b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:04:34.907348 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-28ea421a-f342-45a1-8cec-99ef1b61d448 None None] MFA Rules not processed for user `d25d7a439361492d8d7ba018531a2e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 12:04:34.909452 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-28ea421a-f342-45a1-8cec-99ef1b61d448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:04:34.920566 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 600/1208] 10.222.0.44 () {58 vars in 1009 bytes} [Wed May 25 12:04:34 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 12:04:34.934522 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea421a-f342-45a1-8cec-99ef1b61d448 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:04:34.946570 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea421a-f342-45a1-8cec-99ef1b61d448 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:04:34.951522 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e751dc-aa44-4ae5-b280-342548278a43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be63af25271b49b5903e8fe66a62b1d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:04:34.952234 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e751dc-aa44-4ae5-b280-342548278a43 service neutron] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:04:34.952515 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e751dc-aa44-4ae5-b280-342548278a43 service neutron] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:04:34.952970 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e751dc-aa44-4ae5-b280-342548278a43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:04:34.967350 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e751dc-aa44-4ae5-b280-342548278a43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:04:34.969659 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e751dc-aa44-4ae5-b280-342548278a43 service neutron] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:04:34.998687 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 601/1209] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 12:04:34 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 12:04:35.036101 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 609/1210] 10.222.0.44 () {58 vars in 1057 bytes} [Wed May 25 12:04:34 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 12:04:35.038661 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e751dc-aa44-4ae5-b280-342548278a43 service neutron] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:04:35.051417 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e751dc-aa44-4ae5-b280-342548278a43 service neutron] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:04:35.057482 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71359904-542a-4b1a-af50-8c536da1e412 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94f4a0c602a7495dbb36dd768cc55a47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:04:35.058159 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71359904-542a-4b1a-af50-8c536da1e412 service placement] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:04:35.058449 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71359904-542a-4b1a-af50-8c536da1e412 service placement] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:04:35.058735 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71359904-542a-4b1a-af50-8c536da1e412 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:04:35.060682 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-71359904-542a-4b1a-af50-8c536da1e412 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:04:35.085117 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71359904-542a-4b1a-af50-8c536da1e412 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:04:35.090135 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71359904-542a-4b1a-af50-8c536da1e412 service placement] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:04:35.112867 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 602/1211] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 12:04:35 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 12:04:44.625124 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997601b9-a907-4e45-baa2-3c02e92b7c57 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:04:44.625764 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997601b9-a907-4e45-baa2-3c02e92b7c57 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:04:44.625764 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997601b9-a907-4e45-baa2-3c02e92b7c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:04:44.644338 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-997601b9-a907-4e45-baa2-3c02e92b7c57 None None] MFA Rules not processed for user `be63af25271b49b5903e8fe66a62b1d2`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 12:04:44.645658 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-997601b9-a907-4e45-baa2-3c02e92b7c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:04:44.653050 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 610/1212] 10.222.0.60 () {58 vars in 1015 bytes} [Wed May 25 12:04:44 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 12:04:44.666924 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71359904-542a-4b1a-af50-8c536da1e412 service placement] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:04:44.676251 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71359904-542a-4b1a-af50-8c536da1e412 service placement] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:04:44.682451 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8039e93e-1414-4d28-a760-19f3314c9aa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be63af25271b49b5903e8fe66a62b1d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:04:44.683494 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039e93e-1414-4d28-a760-19f3314c9aa9 service neutron] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:04:44.684183 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039e93e-1414-4d28-a760-19f3314c9aa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:04:44.684920 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039e93e-1414-4d28-a760-19f3314c9aa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:04:44.694942 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8039e93e-1414-4d28-a760-19f3314c9aa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:04:44.697200 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8039e93e-1414-4d28-a760-19f3314c9aa9 service neutron] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:04:44.708863 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 603/1213] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 12:04:44 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 12:04:45.628229 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ba5eb-0e5a-4f6b-9321-37f0cfaf1f0a None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:04:45.628882 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ba5eb-0e5a-4f6b-9321-37f0cfaf1f0a None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:04:45.628882 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ba5eb-0e5a-4f6b-9321-37f0cfaf1f0a None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:04:45.630483 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 611/1214] 10.222.0.44 () {54 vars in 921 bytes} [Wed May 25 12:04:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 12:04:45.667653 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66c56d-b450-4cf8-9c67-a5c90824cc23 None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:04:45.668902 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66c56d-b450-4cf8-9c67-a5c90824cc23 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:04:45.669238 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66c56d-b450-4cf8-9c67-a5c90824cc23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:04:45.691772 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-ff66c56d-b450-4cf8-9c67-a5c90824cc23 None None] MFA Rules not processed for user `d25d7a439361492d8d7ba018531a2e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 12:04:45.693555 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-ff66c56d-b450-4cf8-9c67-a5c90824cc23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:04:45.705153 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 604/1215] 10.222.0.44 () {58 vars in 1018 bytes} [Wed May 25 12:04:45 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 12:04:45.740204 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ba5eb-0e5a-4f6b-9321-37f0cfaf1f0a None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:04:45.762426 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ba5eb-0e5a-4f6b-9321-37f0cfaf1f0a None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:04:45.770403 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d645be60-f687-4e0e-b51e-6c4662c138e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd25d7a439361492d8d7ba018531a2e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:04:45.771571 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645be60-f687-4e0e-b51e-6c4662c138e1 service nova] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:04:45.774213 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645be60-f687-4e0e-b51e-6c4662c138e1 service nova] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:04:45.775014 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645be60-f687-4e0e-b51e-6c4662c138e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:04:45.786507 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d645be60-f687-4e0e-b51e-6c4662c138e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:04:45.788242 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d645be60-f687-4e0e-b51e-6c4662c138e1 service nova] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:04:45.800030 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 612/1216] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 12:04:45 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 12:04:52.246685 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fcb0b-8291-45ce-899b-742152b12063 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:04:52.247255 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fcb0b-8291-45ce-899b-742152b12063 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:04:52.247255 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fcb0b-8291-45ce-899b-742152b12063 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:04:52.248632 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 605/1217] 10.222.0.44 () {54 vars in 921 bytes} [Wed May 25 12:04:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 12:04:52.262219 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf51c7-7cf5-4211-bfe7-f2824ff3f898 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:04:52.262758 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf51c7-7cf5-4211-bfe7-f2824ff3f898 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:04:52.262758 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf51c7-7cf5-4211-bfe7-f2824ff3f898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:04:52.281422 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-13cf51c7-7cf5-4211-bfe7-f2824ff3f898 None None] MFA Rules not processed for user `d25d7a439361492d8d7ba018531a2e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 12:04:52.282542 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-13cf51c7-7cf5-4211-bfe7-f2824ff3f898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:04:52.291105 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 613/1218] 10.222.0.44 () {58 vars in 1018 bytes} [Wed May 25 12:04:52 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 12:04:52.312197 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03fcb0b-8291-45ce-899b-742152b12063 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:04:52.337268 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03fcb0b-8291-45ce-899b-742152b12063 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:04:52.344485 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed1382-c12a-4d40-b085-287f29e20eac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd25d7a439361492d8d7ba018531a2e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:04:52.345144 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed1382-c12a-4d40-b085-287f29e20eac service nova] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:04:52.345424 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed1382-c12a-4d40-b085-287f29e20eac service nova] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:04:52.345805 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed1382-c12a-4d40-b085-287f29e20eac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:04:52.355238 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baed1382-c12a-4d40-b085-287f29e20eac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:04:52.356864 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baed1382-c12a-4d40-b085-287f29e20eac service nova] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:04:52.366697 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 606/1219] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 12:04:52 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 12:05:02.276108 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=69 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 12:05:02.362471 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=96 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 12:05:02.828154 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf51c7-7cf5-4211-bfe7-f2824ff3f898 None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:05:02.837607 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf51c7-7cf5-4211-bfe7-f2824ff3f898 None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:05:02.841160 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3b790-d754-4dfc-b648-9a26c9bb0f8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be63af25271b49b5903e8fe66a62b1d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:05:02.841801 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3b790-d754-4dfc-b648-9a26c9bb0f8b service neutron] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:05:02.842089 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3b790-d754-4dfc-b648-9a26c9bb0f8b service neutron] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:05:02.842366 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3b790-d754-4dfc-b648-9a26c9bb0f8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:05:02.852392 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c3b790-d754-4dfc-b648-9a26c9bb0f8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:05:02.853887 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c3b790-d754-4dfc-b648-9a26c9bb0f8b service neutron] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:05:02.864204 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 614/1220] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 12:05:02 2022] GET /identity/v3/auth/tokens => generated 2877 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 12:05:04.988740 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff5038-0556-4cfd-acc6-87c9fd3fa7c4 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:05:04.989394 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff5038-0556-4cfd-acc6-87c9fd3fa7c4 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:05:04.989394 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff5038-0556-4cfd-acc6-87c9fd3fa7c4 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:05:04.991718 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 607/1221] 10.222.0.44 () {54 vars in 921 bytes} [Wed May 25 12:05:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 12:05:04.997103 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d83c3e-c83f-4f9b-8be4-334dd05f3aab None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:05:04.997695 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d83c3e-c83f-4f9b-8be4-334dd05f3aab None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:05:04.997695 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d83c3e-c83f-4f9b-8be4-334dd05f3aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:05:05.022296 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-a6d83c3e-c83f-4f9b-8be4-334dd05f3aab None None] MFA Rules not processed for user `d25d7a439361492d8d7ba018531a2e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 12:05:05.024221 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-a6d83c3e-c83f-4f9b-8be4-334dd05f3aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:05:05.035223 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 615/1222] 10.222.0.44 () {58 vars in 1018 bytes} [Wed May 25 12:05:04 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 12:05:05.048785 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff5038-0556-4cfd-acc6-87c9fd3fa7c4 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:05:05.064152 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff5038-0556-4cfd-acc6-87c9fd3fa7c4 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:05:05.069603 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf39cd39-269e-423d-8947-7690f319bc31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd25d7a439361492d8d7ba018531a2e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:05:05.070241 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39cd39-269e-423d-8947-7690f319bc31 service nova] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:05:05.070521 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39cd39-269e-423d-8947-7690f319bc31 service nova] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:05:05.070802 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39cd39-269e-423d-8947-7690f319bc31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:05:05.080381 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf39cd39-269e-423d-8947-7690f319bc31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:05:05.082046 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf39cd39-269e-423d-8947-7690f319bc31 service nova] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:05:05.105801 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 608/1223] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 12:05:05 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 12:05:15.015783 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=9 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 12:05:15.088868 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=6 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 12:05:24.157040 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494b1aa-701f-4c26-b3c6-694807e0ee7e None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:05:24.157571 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494b1aa-701f-4c26-b3c6-694807e0ee7e None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:05:24.157571 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494b1aa-701f-4c26-b3c6-694807e0ee7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:05:24.175122 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-6494b1aa-701f-4c26-b3c6-694807e0ee7e None None] MFA Rules not processed for user `4ddf921eab624adea9f4c25e3cda2125`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 12:05:24.176327 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-6494b1aa-701f-4c26-b3c6-694807e0ee7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:05:24.183859 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 616/1224] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 25 12:05:24 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 12:05:34.169966 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=3 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 12:05:46.959487 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c95ec-74dd-4275-80cf-e9395dd99a15 None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:05:46.960059 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c95ec-74dd-4275-80cf-e9395dd99a15 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:05:46.960059 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c95ec-74dd-4275-80cf-e9395dd99a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:05:46.977692 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-764c95ec-74dd-4275-80cf-e9395dd99a15 None None] MFA Rules not processed for user `4ddf921eab624adea9f4c25e3cda2125`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 12:05:46.978866 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-764c95ec-74dd-4275-80cf-e9395dd99a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:05:46.985613 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 609/1225] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 25 12:05:46 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 12:05:47.243604 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f673b30-073a-44d4-a1ee-d0fab4e51cdc None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:05:47.244075 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f673b30-073a-44d4-a1ee-d0fab4e51cdc None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:05:47.244183 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f673b30-073a-44d4-a1ee-d0fab4e51cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:05:47.261920 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-6f673b30-073a-44d4-a1ee-d0fab4e51cdc None None] MFA Rules not processed for user `be63af25271b49b5903e8fe66a62b1d2`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 12:05:47.263100 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-6f673b30-073a-44d4-a1ee-d0fab4e51cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:05:47.269497 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 617/1226] 10.222.0.44 () {58 vars in 1009 bytes} [Wed May 25 12:05:47 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 12:05:47.280687 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764c95ec-74dd-4275-80cf-e9395dd99a15 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:05:47.290517 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764c95ec-74dd-4275-80cf-e9395dd99a15 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:05:47.294026 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a48512-0016-4270-b04c-38b2df9925cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be63af25271b49b5903e8fe66a62b1d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:05:47.294658 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a48512-0016-4270-b04c-38b2df9925cd service neutron] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:05:47.294941 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a48512-0016-4270-b04c-38b2df9925cd service neutron] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:05:47.295217 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a48512-0016-4270-b04c-38b2df9925cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:05:47.302146 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a48512-0016-4270-b04c-38b2df9925cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:05:47.303565 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a48512-0016-4270-b04c-38b2df9925cd service neutron] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:05:47.311130 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 610/1227] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 12:05:47 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 12:05:57.256580 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=3 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 12:05:57.307863 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=9 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 12:06:00.407107 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e60b3e-c622-4bcc-9c1f-70a10f604864 None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:06:00.407607 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e60b3e-c622-4bcc-9c1f-70a10f604864 None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:06:00.407694 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e60b3e-c622-4bcc-9c1f-70a10f604864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:06:00.425109 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-b5e60b3e-c622-4bcc-9c1f-70a10f604864 None None] MFA Rules not processed for user `4ddf921eab624adea9f4c25e3cda2125`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 12:06:00.426296 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-b5e60b3e-c622-4bcc-9c1f-70a10f604864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:06:00.433649 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 618/1228] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 25 12:06:00 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 12:06:10.420928 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=3 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 12:06:35.237051 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17864dcd-497d-48a9-98e6-d78f2e86e345 None None] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:06:35.237607 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17864dcd-497d-48a9-98e6-d78f2e86e345 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:06:35.237702 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17864dcd-497d-48a9-98e6-d78f2e86e345 None None] PATH_INFO: `/` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:06:35.239463 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 611/1229] 10.222.0.44 () {54 vars in 921 bytes} [Wed May 25 12:06:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 12:06:35.247778 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5906891-5442-4be3-b896-8c31bee13a4c None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:06:35.248287 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5906891-5442-4be3-b896-8c31bee13a4c None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:06:35.248547 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5906891-5442-4be3-b896-8c31bee13a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:06:35.294138 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-f5906891-5442-4be3-b896-8c31bee13a4c None None] MFA Rules not processed for user `94f4a0c602a7495dbb36dd768cc55a47`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 12:06:35.295601 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-f5906891-5442-4be3-b896-8c31bee13a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:06:35.307735 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 619/1230] 10.222.0.44 () {58 vars in 1018 bytes} [Wed May 25 12:06:35 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 12:06:35.332613 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17864dcd-497d-48a9-98e6-d78f2e86e345 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:06:35.348584 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17864dcd-497d-48a9-98e6-d78f2e86e345 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:06:35.355477 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08087241-bd87-4833-9ed6-0aec4e0a4c68 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94f4a0c602a7495dbb36dd768cc55a47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:06:35.356141 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08087241-bd87-4833-9ed6-0aec4e0a4c68 service placement] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:06:35.356446 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08087241-bd87-4833-9ed6-0aec4e0a4c68 service placement] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:06:35.356701 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08087241-bd87-4833-9ed6-0aec4e0a4c68 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:06:35.367385 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08087241-bd87-4833-9ed6-0aec4e0a4c68 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:06:35.369302 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08087241-bd87-4833-9ed6-0aec4e0a4c68 service placement] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:06:35.380854 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 612/1231] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 12:06:35 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 12:06:38.970016 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5906891-5442-4be3-b896-8c31bee13a4c None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:06:39.062750 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5906891-5442-4be3-b896-8c31bee13a4c None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:06:39.068260 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7201ed-0626-4761-b432-608f8b1fc6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7103ef35356d4cd6a0f435bed6b1df47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:06:39.070823 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7201ed-0626-4761-b432-608f8b1fc6b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:06:39.070823 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7201ed-0626-4761-b432-608f8b1fc6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:06:39.070823 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7201ed-0626-4761-b432-608f8b1fc6b0 admin admin] PATH_INFO: `/v3/users/d1cd7766bc474a8692431e314e7e4d1b` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:06:39.071113 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7201ed-0626-4761-b432-608f8b1fc6b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1cd7766bc474a8692431e314e7e4d1b)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:06:39.072251 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: WARNING py.warnings [None req-8d7201ed-0626-4761-b432-608f8b1fc6b0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 12:06:39.072251 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: warnings.warn(msg) May 25 12:06:39.072251 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: May 25 12:06:39.073881 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7201ed-0626-4761-b432-608f8b1fc6b0 admin admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:06:39.147906 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.notifications [None req-8d7201ed-0626-4761-b432-608f8b1fc6b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1cd7766bc474a8692431e314e7e4d1b'} {{(pid=86939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 12:06:39.148546 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.notifications [None req-8d7201ed-0626-4761-b432-608f8b1fc6b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1cd7766bc474a8692431e314e7e4d1b'} {{(pid=86939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 12:06:39.149268 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.notifications [None req-8d7201ed-0626-4761-b432-608f8b1fc6b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1cd7766bc474a8692431e314e7e4d1b'} {{(pid=86939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 12:06:39.158652 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.notifications [None req-8d7201ed-0626-4761-b432-608f8b1fc6b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1cd7766bc474a8692431e314e7e4d1b'} {{(pid=86939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 12:06:39.187882 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.notifications [None req-8d7201ed-0626-4761-b432-608f8b1fc6b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1cd7766bc474a8692431e314e7e4d1b'} {{(pid=86939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 12:06:39.208686 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 620/1232] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 25 12:06:38 2022] DELETE /identity/v3/users/d1cd7766bc474a8692431e314e7e4d1b => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 12:06:39.410171 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08087241-bd87-4833-9ed6-0aec4e0a4c68 service placement] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:06:39.421384 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08087241-bd87-4833-9ed6-0aec4e0a4c68 service placement] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:06:39.497467 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac12773-0350-441a-9bbf-b47c8f10b464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7103ef35356d4cd6a0f435bed6b1df47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:06:39.498408 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac12773-0350-441a-9bbf-b47c8f10b464 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:06:39.500327 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac12773-0350-441a-9bbf-b47c8f10b464 admin admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:06:39.500661 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac12773-0350-441a-9bbf-b47c8f10b464 admin admin] PATH_INFO: `/v3/projects/516650671d6e40f3a7e8b14dceaa2be5` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:06:39.502038 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac12773-0350-441a-9bbf-b47c8f10b464 admin admin] RBAC: Authorizing `identity:delete_project(project_id=516650671d6e40f3a7e8b14dceaa2be5)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:06:39.503067 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: WARNING py.warnings [None req-fac12773-0350-441a-9bbf-b47c8f10b464 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 12:06:39.503067 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: warnings.warn(msg) May 25 12:06:39.503067 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: May 25 12:06:39.504304 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac12773-0350-441a-9bbf-b47c8f10b464 admin admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:06:39.567233 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.notifications [None req-fac12773-0350-441a-9bbf-b47c8f10b464 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '516650671d6e40f3a7e8b14dceaa2be5', 'request_id': 'req-fac12773-0350-441a-9bbf-b47c8f10b464'} {{(pid=86938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 12:06:39.581837 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.notifications [None req-fac12773-0350-441a-9bbf-b47c8f10b464 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '516650671d6e40f3a7e8b14dceaa2be5', 'request_id': 'req-fac12773-0350-441a-9bbf-b47c8f10b464'} {{(pid=86938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 12:06:39.588604 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.notifications [None req-fac12773-0350-441a-9bbf-b47c8f10b464 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '516650671d6e40f3a7e8b14dceaa2be5', 'request_id': 'req-fac12773-0350-441a-9bbf-b47c8f10b464'} {{(pid=86938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 12:06:39.604403 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.notifications [None req-fac12773-0350-441a-9bbf-b47c8f10b464 admin admin] The token cache is being invalidate because project 516650671d6e40f3a7e8b14dceaa2be5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 12:06:39.604867 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.notifications [None req-fac12773-0350-441a-9bbf-b47c8f10b464 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 12:06:39.605548 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.notifications [None req-fac12773-0350-441a-9bbf-b47c8f10b464 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 12:06:39.607103 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 613/1233] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 25 12:06:39 2022] DELETE /identity/v3/projects/516650671d6e40f3a7e8b14dceaa2be5 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 12:06:39.611248 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7201ed-0626-4761-b432-608f8b1fc6b0 admin admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:06:39.612699 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-8d7201ed-0626-4761-b432-608f8b1fc6b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:06:39.626789 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7201ed-0626-4761-b432-608f8b1fc6b0 admin admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:06:39.667975 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 12:06:39.686792 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd2451-35fb-4df9-bea4-d245e710d850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7103ef35356d4cd6a0f435bed6b1df47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:06:39.687832 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd2451-35fb-4df9-bea4-d245e710d850 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:06:39.688091 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd2451-35fb-4df9-bea4-d245e710d850 admin admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:06:39.688488 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd2451-35fb-4df9-bea4-d245e710d850 admin admin] PATH_INFO: `/v3/users/140c36f8f35d4ae89e2785e0d0c65ac9` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:06:39.689898 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdd2451-35fb-4df9-bea4-d245e710d850 admin admin] RBAC: Authorizing `identity:delete_user(user_id=140c36f8f35d4ae89e2785e0d0c65ac9)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:06:39.692025 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdd2451-35fb-4df9-bea4-d245e710d850 admin admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:06:39.741488 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.notifications [None req-1cdd2451-35fb-4df9-bea4-d245e710d850 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '140c36f8f35d4ae89e2785e0d0c65ac9'} {{(pid=86939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 12:06:39.742176 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.notifications [None req-1cdd2451-35fb-4df9-bea4-d245e710d850 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '140c36f8f35d4ae89e2785e0d0c65ac9'} {{(pid=86939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 12:06:39.742887 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.notifications [None req-1cdd2451-35fb-4df9-bea4-d245e710d850 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '140c36f8f35d4ae89e2785e0d0c65ac9'} {{(pid=86939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 12:06:39.751413 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.notifications [None req-1cdd2451-35fb-4df9-bea4-d245e710d850 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '140c36f8f35d4ae89e2785e0d0c65ac9'} {{(pid=86939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 12:06:39.767842 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.notifications [None req-1cdd2451-35fb-4df9-bea4-d245e710d850 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '140c36f8f35d4ae89e2785e0d0c65ac9'} {{(pid=86939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 12:06:39.781022 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 621/1234] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 25 12:06:39 2022] DELETE /identity/v3/users/140c36f8f35d4ae89e2785e0d0c65ac9 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 12:06:39.967542 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac12773-0350-441a-9bbf-b47c8f10b464 admin admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:06:39.969008 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-fac12773-0350-441a-9bbf-b47c8f10b464 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:06:39.982616 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac12773-0350-441a-9bbf-b47c8f10b464 admin admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:06:40.051041 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d2780-dab7-4786-8651-73e6b7b41944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7103ef35356d4cd6a0f435bed6b1df47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:06:40.052230 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d2780-dab7-4786-8651-73e6b7b41944 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:06:40.052578 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d2780-dab7-4786-8651-73e6b7b41944 admin admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:06:40.052897 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d2780-dab7-4786-8651-73e6b7b41944 admin admin] PATH_INFO: `/v3/projects/47bd8d60f015447b8f2f0d159e073f18` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:06:40.054312 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28d2780-dab7-4786-8651-73e6b7b41944 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47bd8d60f015447b8f2f0d159e073f18)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:06:40.056355 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28d2780-dab7-4786-8651-73e6b7b41944 admin admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:06:40.079956 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 12:06:40.107507 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.notifications [None req-d28d2780-dab7-4786-8651-73e6b7b41944 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47bd8d60f015447b8f2f0d159e073f18', 'request_id': 'req-d28d2780-dab7-4786-8651-73e6b7b41944'} {{(pid=86938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 12:06:40.114063 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.notifications [None req-d28d2780-dab7-4786-8651-73e6b7b41944 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47bd8d60f015447b8f2f0d159e073f18', 'request_id': 'req-d28d2780-dab7-4786-8651-73e6b7b41944'} {{(pid=86938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 12:06:40.120455 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.notifications [None req-d28d2780-dab7-4786-8651-73e6b7b41944 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47bd8d60f015447b8f2f0d159e073f18', 'request_id': 'req-d28d2780-dab7-4786-8651-73e6b7b41944'} {{(pid=86938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 12:06:40.134201 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.notifications [None req-d28d2780-dab7-4786-8651-73e6b7b41944 admin admin] The token cache is being invalidate because project 47bd8d60f015447b8f2f0d159e073f18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 12:06:40.134484 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.notifications [None req-d28d2780-dab7-4786-8651-73e6b7b41944 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 12:06:40.135114 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.notifications [None req-d28d2780-dab7-4786-8651-73e6b7b41944 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 12:06:40.136744 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 614/1235] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 25 12:06:39 2022] DELETE /identity/v3/projects/47bd8d60f015447b8f2f0d159e073f18 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 12:06:49.777267 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=33,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 12:06:50.130916 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 12:06:58.669560 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a7c50-63cf-4529-a1d2-1bab6a82589e None None] REQUEST_METHOD: `POST` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:06:58.670048 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a7c50-63cf-4529-a1d2-1bab6a82589e None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:06:58.670137 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a7c50-63cf-4529-a1d2-1bab6a82589e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:06:58.687080 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.auth.core [None req-a34a7c50-63cf-4529-a1d2-1bab6a82589e None None] MFA Rules not processed for user `4ddf921eab624adea9f4c25e3cda2125`. Rule list: `[]` (Enabled: `True`). {{(pid=86939) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 12:06:58.688440 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-a34a7c50-63cf-4529-a1d2-1bab6a82589e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:06:58.740913 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 622/1236] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 25 12:06:58 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 12:07:08.734249 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=25 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 12:07:11.456102 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d2780-dab7-4786-8651-73e6b7b41944 admin admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:07:11.457520 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-d28d2780-dab7-4786-8651-73e6b7b41944 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:07:11.520594 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d2780-dab7-4786-8651-73e6b7b41944 admin admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:07:11.524141 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19808b7d-3006-491b-834f-ad7facddc125 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be63af25271b49b5903e8fe66a62b1d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:07:11.524777 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19808b7d-3006-491b-834f-ad7facddc125 service neutron] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:07:11.525058 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19808b7d-3006-491b-834f-ad7facddc125 service neutron] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:07:11.525334 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19808b7d-3006-491b-834f-ad7facddc125 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:07:11.527048 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-19808b7d-3006-491b-834f-ad7facddc125 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:07:11.587279 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19808b7d-3006-491b-834f-ad7facddc125 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:07:11.588778 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19808b7d-3006-491b-834f-ad7facddc125 service neutron] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:07:11.598635 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 615/1237] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 12:07:11 2022] GET /identity/v3/auth/tokens => generated 2873 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 12:07:21.594624 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=54 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 12:08:35.269386 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a7c50-63cf-4529-a1d2-1bab6a82589e None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:08:35.270799 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-a34a7c50-63cf-4529-a1d2-1bab6a82589e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:08:35.352253 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a7c50-63cf-4529-a1d2-1bab6a82589e None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:08:35.357232 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17cb7e-44b9-4f8d-bd75-59518d51b04d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94f4a0c602a7495dbb36dd768cc55a47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:08:35.357898 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17cb7e-44b9-4f8d-bd75-59518d51b04d service placement] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:08:35.358190 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17cb7e-44b9-4f8d-bd75-59518d51b04d service placement] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:08:35.358472 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17cb7e-44b9-4f8d-bd75-59518d51b04d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:08:35.360285 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-2b17cb7e-44b9-4f8d-bd75-59518d51b04d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:08:35.371254 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17cb7e-44b9-4f8d-bd75-59518d51b04d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:08:35.372871 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17cb7e-44b9-4f8d-bd75-59518d51b04d service placement] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:08:35.382614 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 623/1238] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 12:08:35 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 12:08:45.378540 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=36 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 12:09:21.705334 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e07977-012c-4b2b-849e-7530bfa735e1 None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:09:21.705847 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e07977-012c-4b2b-849e-7530bfa735e1 None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:09:21.705941 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e07977-012c-4b2b-849e-7530bfa735e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:09:21.723430 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-26e07977-012c-4b2b-849e-7530bfa735e1 None None] MFA Rules not processed for user `4ddf921eab624adea9f4c25e3cda2125`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 12:09:21.724636 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-26e07977-012c-4b2b-849e-7530bfa735e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:09:21.731284 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 616/1239] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 25 12:09:21 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 12:09:25.977217 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17cb7e-44b9-4f8d-bd75-59518d51b04d service placement] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:09:25.978642 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-2b17cb7e-44b9-4f8d-bd75-59518d51b04d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:09:26.059244 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17cb7e-44b9-4f8d-bd75-59518d51b04d service placement] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:09:26.064729 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64aef6-dca0-4b6f-b5bd-9c4a5e39a738 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd25d7a439361492d8d7ba018531a2e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:09:26.065380 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64aef6-dca0-4b6f-b5bd-9c4a5e39a738 service nova] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:09:26.065667 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64aef6-dca0-4b6f-b5bd-9c4a5e39a738 service nova] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:09:26.065946 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64aef6-dca0-4b6f-b5bd-9c4a5e39a738 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:09:26.067727 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-2d64aef6-dca0-4b6f-b5bd-9c4a5e39a738 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:09:26.078747 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d64aef6-dca0-4b6f-b5bd-9c4a5e39a738 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:09:26.080373 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d64aef6-dca0-4b6f-b5bd-9c4a5e39a738 service nova] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:09:26.089413 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 624/1240] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 12:09:25 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 12:09:31.717917 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=3 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 12:09:34.349867 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e07977-012c-4b2b-849e-7530bfa735e1 None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:09:34.359131 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e07977-012c-4b2b-849e-7530bfa735e1 None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:09:34.363590 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c04c13-2302-4cbb-8e57-0f6463740c38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be63af25271b49b5903e8fe66a62b1d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:09:34.364288 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c04c13-2302-4cbb-8e57-0f6463740c38 service neutron] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:09:34.364576 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c04c13-2302-4cbb-8e57-0f6463740c38 service neutron] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:09:34.364855 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c04c13-2302-4cbb-8e57-0f6463740c38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:09:34.366703 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-59c04c13-2302-4cbb-8e57-0f6463740c38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:09:34.380239 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c04c13-2302-4cbb-8e57-0f6463740c38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:09:34.381685 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c04c13-2302-4cbb-8e57-0f6463740c38 service neutron] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:09:34.392156 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 617/1241] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 12:09:34 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 12:09:36.085330 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=36 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 12:09:44.387506 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=6 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 12:10:36.003640 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64aef6-dca0-4b6f-b5bd-9c4a5e39a738 service nova] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:10:36.013027 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64aef6-dca0-4b6f-b5bd-9c4a5e39a738 service nova] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:10:36.017195 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c57c18-1e6a-42ed-9f8a-0c4dc264a0f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be63af25271b49b5903e8fe66a62b1d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:10:36.017816 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c57c18-1e6a-42ed-9f8a-0c4dc264a0f0 service neutron] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:10:36.018100 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c57c18-1e6a-42ed-9f8a-0c4dc264a0f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:10:36.018383 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c57c18-1e6a-42ed-9f8a-0c4dc264a0f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:10:36.020241 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-98c57c18-1e6a-42ed-9f8a-0c4dc264a0f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:10:36.029535 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c57c18-1e6a-42ed-9f8a-0c4dc264a0f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:10:36.031556 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c57c18-1e6a-42ed-9f8a-0c4dc264a0f0 service neutron] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:10:36.039339 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 625/1242] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 12:10:36 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 12:10:46.035965 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=6 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 12:11:14.925323 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a30cc4-32dc-48d3-ab52-0c021d3eff7d None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:11:14.925827 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a30cc4-32dc-48d3-ab52-0c021d3eff7d None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:11:14.925921 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a30cc4-32dc-48d3-ab52-0c021d3eff7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:11:14.942724 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-18a30cc4-32dc-48d3-ab52-0c021d3eff7d None None] MFA Rules not processed for user `4ddf921eab624adea9f4c25e3cda2125`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 12:11:14.943940 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-18a30cc4-32dc-48d3-ab52-0c021d3eff7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:11:14.950616 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 618/1243] 10.222.0.44 () {58 vars in 957 bytes} [Wed May 25 12:11:14 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 12:11:14.989121 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c57c18-1e6a-42ed-9f8a-0c4dc264a0f0 service neutron] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:11:14.990531 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-98c57c18-1e6a-42ed-9f8a-0c4dc264a0f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:11:15.054026 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c57c18-1e6a-42ed-9f8a-0c4dc264a0f0 service neutron] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:11:15.057575 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0513757-2d78-4ced-b85c-7c0fd4fcabc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c940de37d2d453c875d3ab6c077a331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:11:15.058207 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0513757-2d78-4ced-b85c-7c0fd4fcabc7 service cinder] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:11:15.058488 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0513757-2d78-4ced-b85c-7c0fd4fcabc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:11:15.058761 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0513757-2d78-4ced-b85c-7c0fd4fcabc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:11:15.060501 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-e0513757-2d78-4ced-b85c-7c0fd4fcabc7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:11:15.072395 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0513757-2d78-4ced-b85c-7c0fd4fcabc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:11:15.073773 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0513757-2d78-4ced-b85c-7c0fd4fcabc7 service cinder] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:11:15.084109 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 626/1244] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 12:11:14 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 12:11:15.365337 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a30cc4-32dc-48d3-ab52-0c021d3eff7d None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:11:15.374467 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a30cc4-32dc-48d3-ab52-0c021d3eff7d None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:11:15.378465 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf662b-31d8-4142-a852-e2c2d06bbf7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be63af25271b49b5903e8fe66a62b1d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:11:15.379088 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf662b-31d8-4142-a852-e2c2d06bbf7c service neutron] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:11:15.379369 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf662b-31d8-4142-a852-e2c2d06bbf7c service neutron] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:11:15.379669 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf662b-31d8-4142-a852-e2c2d06bbf7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:11:15.381417 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-40cf662b-31d8-4142-a852-e2c2d06bbf7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:11:15.390288 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cf662b-31d8-4142-a852-e2c2d06bbf7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:11:15.392374 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cf662b-31d8-4142-a852-e2c2d06bbf7c service neutron] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:11:15.399913 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 619/1245] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 12:11:15 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 12:11:15.828250 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0513757-2d78-4ced-b85c-7c0fd4fcabc7 service cinder] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:11:15.840562 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0513757-2d78-4ced-b85c-7c0fd4fcabc7 service cinder] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:11:15.845500 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f27856d-5922-4915-9362-878009e9b512 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94f4a0c602a7495dbb36dd768cc55a47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:11:15.846144 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27856d-5922-4915-9362-878009e9b512 service placement] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:11:15.846429 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27856d-5922-4915-9362-878009e9b512 service placement] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:11:15.846711 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27856d-5922-4915-9362-878009e9b512 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:11:15.848510 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-7f27856d-5922-4915-9362-878009e9b512 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:11:15.862578 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f27856d-5922-4915-9362-878009e9b512 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:11:15.864240 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f27856d-5922-4915-9362-878009e9b512 service placement] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:11:15.876699 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 627/1246] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 12:11:15 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 12:11:18.172537 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf662b-31d8-4142-a852-e2c2d06bbf7c service neutron] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:11:18.174842 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-40cf662b-31d8-4142-a852-e2c2d06bbf7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:11:18.203956 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf662b-31d8-4142-a852-e2c2d06bbf7c service neutron] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:11:18.211218 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7154d1c8-5446-4998-ab37-0ae4a480570e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd25d7a439361492d8d7ba018531a2e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:11:18.212069 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154d1c8-5446-4998-ab37-0ae4a480570e service nova] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:11:18.212449 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154d1c8-5446-4998-ab37-0ae4a480570e service nova] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:11:18.212821 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154d1c8-5446-4998-ab37-0ae4a480570e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:11:18.215622 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-7154d1c8-5446-4998-ab37-0ae4a480570e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:11:18.228407 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7154d1c8-5446-4998-ab37-0ae4a480570e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:11:18.230050 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7154d1c8-5446-4998-ab37-0ae4a480570e service nova] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:11:18.241620 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 620/1247] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 12:11:18 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 12:11:24.182274 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f27856d-5922-4915-9362-878009e9b512 service placement] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:11:24.195050 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f27856d-5922-4915-9362-878009e9b512 service placement] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:11:24.199569 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b51620-33ba-4886-b0f9-578b561911a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd25d7a439361492d8d7ba018531a2e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:11:24.200320 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b51620-33ba-4886-b0f9-578b561911a4 service nova] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:11:24.200665 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b51620-33ba-4886-b0f9-578b561911a4 service nova] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:11:24.201006 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b51620-33ba-4886-b0f9-578b561911a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:11:24.202844 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-31b51620-33ba-4886-b0f9-578b561911a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:11:24.215000 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b51620-33ba-4886-b0f9-578b561911a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:11:24.216630 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b51620-33ba-4886-b0f9-578b561911a4 service nova] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:11:24.226412 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 628/1248] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 12:11:24 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 12:11:28.236425 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=15 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 12:11:34.222287 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=42 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 12:13:41.713225 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7154d1c8-5446-4998-ab37-0ae4a480570e service nova] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:13:41.761559 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7154d1c8-5446-4998-ab37-0ae4a480570e service nova] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:13:41.768187 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346eb01-6727-4fc3-a5a3-ae81fb2436bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd25d7a439361492d8d7ba018531a2e7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:13:41.768840 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346eb01-6727-4fc3-a5a3-ae81fb2436bd service nova] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:13:41.769127 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346eb01-6727-4fc3-a5a3-ae81fb2436bd service nova] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:13:41.769405 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346eb01-6727-4fc3-a5a3-ae81fb2436bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:13:41.771736 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-4346eb01-6727-4fc3-a5a3-ae81fb2436bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:13:41.806246 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4346eb01-6727-4fc3-a5a3-ae81fb2436bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:13:41.808005 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4346eb01-6727-4fc3-a5a3-ae81fb2436bd service nova] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:13:41.822347 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 621/1249] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 12:13:41 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 12:13:43.376046 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b51620-33ba-4886-b0f9-578b561911a4 service nova] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:13:43.377509 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-31b51620-33ba-4886-b0f9-578b561911a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:13:43.445840 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b51620-33ba-4886-b0f9-578b561911a4 service nova] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:13:43.450970 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37f9e8-33ea-4fde-8f1b-057d7af0bdf9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94f4a0c602a7495dbb36dd768cc55a47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:13:43.451627 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37f9e8-33ea-4fde-8f1b-057d7af0bdf9 service placement] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:13:43.451946 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37f9e8-33ea-4fde-8f1b-057d7af0bdf9 service placement] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:13:43.452224 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37f9e8-33ea-4fde-8f1b-057d7af0bdf9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:13:43.460853 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f37f9e8-33ea-4fde-8f1b-057d7af0bdf9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:13:43.462443 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f37f9e8-33ea-4fde-8f1b-057d7af0bdf9 service placement] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:13:43.472199 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 629/1250] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 12:13:43 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 12:13:48.325235 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346eb01-6727-4fc3-a5a3-ae81fb2436bd service nova] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:13:48.326661 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-4346eb01-6727-4fc3-a5a3-ae81fb2436bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:13:48.338413 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346eb01-6727-4fc3-a5a3-ae81fb2436bd service nova] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:13:48.341917 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0174c3a8-b1e2-40f6-9dd5-d94bd89d9bcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be63af25271b49b5903e8fe66a62b1d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:13:48.342545 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174c3a8-b1e2-40f6-9dd5-d94bd89d9bcd service neutron] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:13:48.342829 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174c3a8-b1e2-40f6-9dd5-d94bd89d9bcd service neutron] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:13:48.343107 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174c3a8-b1e2-40f6-9dd5-d94bd89d9bcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:13:48.344797 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-0174c3a8-b1e2-40f6-9dd5-d94bd89d9bcd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:13:48.427813 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0174c3a8-b1e2-40f6-9dd5-d94bd89d9bcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:13:48.429777 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0174c3a8-b1e2-40f6-9dd5-d94bd89d9bcd service neutron] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:13:48.439132 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 622/1251] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 12:13:48 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 12:13:51.370575 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38456fdf-0b6a-4395-a86d-1c5d3089a95e None None] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:13:51.371043 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38456fdf-0b6a-4395-a86d-1c5d3089a95e None None] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:13:51.371148 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38456fdf-0b6a-4395-a86d-1c5d3089a95e None None] PATH_INFO: `/` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:13:51.372736 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 630/1252] 10.222.0.44 () {54 vars in 921 bytes} [Wed May 25 12:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 12:13:51.383708 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddcca4e-cd77-4a8f-aaff-9000d539007d None None] REQUEST_METHOD: `POST` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:13:51.384219 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddcca4e-cd77-4a8f-aaff-9000d539007d None None] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:13:51.384528 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddcca4e-cd77-4a8f-aaff-9000d539007d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:13:51.450621 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.auth.core [None req-5ddcca4e-cd77-4a8f-aaff-9000d539007d None None] MFA Rules not processed for user `94f4a0c602a7495dbb36dd768cc55a47`. Rule list: `[]` (Enabled: `True`). {{(pid=86938) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 12:13:51.452665 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-5ddcca4e-cd77-4a8f-aaff-9000d539007d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:13:51.461465 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 623/1253] 10.222.0.44 () {58 vars in 1018 bytes} [Wed May 25 12:13:51 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 12:13:51.474847 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38456fdf-0b6a-4395-a86d-1c5d3089a95e None None] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:13:51.491136 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38456fdf-0b6a-4395-a86d-1c5d3089a95e None None] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:13:51.496710 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95e0065-1ef4-4043-9bb4-cd8aa77b64e2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94f4a0c602a7495dbb36dd768cc55a47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:13:51.497355 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e0065-1ef4-4043-9bb4-cd8aa77b64e2 service placement] REQUEST_METHOD: `GET` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:13:51.497642 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e0065-1ef4-4043-9bb4-cd8aa77b64e2 service placement] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:13:51.497926 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e0065-1ef4-4043-9bb4-cd8aa77b64e2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:13:51.507847 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95e0065-1ef4-4043-9bb4-cd8aa77b64e2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:13:51.509646 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95e0065-1ef4-4043-9bb4-cd8aa77b64e2 service placement] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:13:51.519313 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 631/1254] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 12:13:51 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 12:13:54.468024 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddcca4e-cd77-4a8f-aaff-9000d539007d None None] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:13:54.481950 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddcca4e-cd77-4a8f-aaff-9000d539007d None None] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:13:54.492340 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef03d5-273b-4ac3-8195-19eee6939523 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94f4a0c602a7495dbb36dd768cc55a47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '57e08d47948142978437098a8120be78', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:13:54.493019 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef03d5-273b-4ac3-8195-19eee6939523 service placement] REQUEST_METHOD: `GET` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:13:54.493308 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef03d5-273b-4ac3-8195-19eee6939523 service placement] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:13:54.493712 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef03d5-273b-4ac3-8195-19eee6939523 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:13:54.496133 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-2fef03d5-273b-4ac3-8195-19eee6939523 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:13:54.510519 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fef03d5-273b-4ac3-8195-19eee6939523 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:13:54.513117 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fef03d5-273b-4ac3-8195-19eee6939523 service placement] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:13:54.529406 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 624/1255] 10.222.0.44 () {60 vars in 1365 bytes} [Wed May 25 12:13:54 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 12:13:54.533999 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95e0065-1ef4-4043-9bb4-cd8aa77b64e2 service placement] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:13:54.536013 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-e95e0065-1ef4-4043-9bb4-cd8aa77b64e2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:13:54.562059 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95e0065-1ef4-4043-9bb4-cd8aa77b64e2 service placement] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:13:54.567619 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4187188-f654-4430-9b73-09ad20595ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7103ef35356d4cd6a0f435bed6b1df47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:13:54.568485 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4187188-f654-4430-9b73-09ad20595ab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:13:54.568835 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4187188-f654-4430-9b73-09ad20595ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:13:54.569040 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4187188-f654-4430-9b73-09ad20595ab7 admin admin] PATH_INFO: `/v3/users/4ddf921eab624adea9f4c25e3cda2125` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:13:54.570292 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4187188-f654-4430-9b73-09ad20595ab7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ddf921eab624adea9f4c25e3cda2125)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:13:54.576384 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4187188-f654-4430-9b73-09ad20595ab7 admin admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:13:54.627963 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.notifications [None req-b4187188-f654-4430-9b73-09ad20595ab7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ddf921eab624adea9f4c25e3cda2125'} {{(pid=86939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 12:13:54.628619 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.notifications [None req-b4187188-f654-4430-9b73-09ad20595ab7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ddf921eab624adea9f4c25e3cda2125'} {{(pid=86939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 12:13:54.629218 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.notifications [None req-b4187188-f654-4430-9b73-09ad20595ab7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ddf921eab624adea9f4c25e3cda2125'} {{(pid=86939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 12:13:54.636376 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.notifications [None req-b4187188-f654-4430-9b73-09ad20595ab7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ddf921eab624adea9f4c25e3cda2125'} {{(pid=86939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 12:13:54.648791 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.notifications [None req-b4187188-f654-4430-9b73-09ad20595ab7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ddf921eab624adea9f4c25e3cda2125'} {{(pid=86939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 12:13:54.660575 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 632/1256] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 25 12:13:54 2022] DELETE /identity/v3/users/4ddf921eab624adea9f4c25e3cda2125 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 12:13:54.831341 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef03d5-273b-4ac3-8195-19eee6939523 service placement] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:13:54.842733 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef03d5-273b-4ac3-8195-19eee6939523 service placement] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:13:54.871911 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=100 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 12:13:54.900539 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e72fd81-c4ad-457e-94c7-a0a4e7136aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7103ef35356d4cd6a0f435bed6b1df47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:13:54.901403 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72fd81-c4ad-457e-94c7-a0a4e7136aa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:13:54.901692 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72fd81-c4ad-457e-94c7-a0a4e7136aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:13:54.901973 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72fd81-c4ad-457e-94c7-a0a4e7136aa7 admin admin] PATH_INFO: `/v3/projects/5d5b817680ec402db3018aefe57ebc8f` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:13:54.903149 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e72fd81-c4ad-457e-94c7-a0a4e7136aa7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d5b817680ec402db3018aefe57ebc8f)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:13:54.905089 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e72fd81-c4ad-457e-94c7-a0a4e7136aa7 admin admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:13:54.949051 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.notifications [None req-3e72fd81-c4ad-457e-94c7-a0a4e7136aa7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d5b817680ec402db3018aefe57ebc8f', 'request_id': 'req-3e72fd81-c4ad-457e-94c7-a0a4e7136aa7'} {{(pid=86938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 12:13:54.954896 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.notifications [None req-3e72fd81-c4ad-457e-94c7-a0a4e7136aa7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d5b817680ec402db3018aefe57ebc8f', 'request_id': 'req-3e72fd81-c4ad-457e-94c7-a0a4e7136aa7'} {{(pid=86938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 12:13:54.960916 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.notifications [None req-3e72fd81-c4ad-457e-94c7-a0a4e7136aa7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d5b817680ec402db3018aefe57ebc8f', 'request_id': 'req-3e72fd81-c4ad-457e-94c7-a0a4e7136aa7'} {{(pid=86938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 12:13:54.972907 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.notifications [None req-3e72fd81-c4ad-457e-94c7-a0a4e7136aa7 admin admin] The token cache is being invalidate because project 5d5b817680ec402db3018aefe57ebc8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 12:13:54.973195 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.notifications [None req-3e72fd81-c4ad-457e-94c7-a0a4e7136aa7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 12:13:54.973807 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.notifications [None req-3e72fd81-c4ad-457e-94c7-a0a4e7136aa7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 12:13:54.975322 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 625/1257] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 25 12:13:54 2022] DELETE /identity/v3/projects/5d5b817680ec402db3018aefe57ebc8f => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 12:13:54.979348 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4187188-f654-4430-9b73-09ad20595ab7 admin admin] Authenticating user token {{(pid=86939) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:13:54.980870 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.fernet_utils [None req-b4187188-f654-4430-9b73-09ad20595ab7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86939) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:13:54.993781 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4187188-f654-4430-9b73-09ad20595ab7 admin admin] Validating token access rules against request {{(pid=86939) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:13:55.043998 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 12:13:55.055980 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3391c8d7-ccf7-48aa-be89-f1841d637242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7103ef35356d4cd6a0f435bed6b1df47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86939) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:13:55.056866 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391c8d7-ccf7-48aa-be89-f1841d637242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:13:55.057165 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391c8d7-ccf7-48aa-be89-f1841d637242 admin admin] SCRIPT_NAME: `/identity` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:13:55.057469 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391c8d7-ccf7-48aa-be89-f1841d637242 admin admin] PATH_INFO: `/v3/users/b8b4456c32a64e7e88e6efb5dc2e8a97` {{(pid=86939) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:13:55.058600 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3391c8d7-ccf7-48aa-be89-f1841d637242 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8b4456c32a64e7e88e6efb5dc2e8a97)` {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:13:55.060564 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3391c8d7-ccf7-48aa-be89-f1841d637242 admin admin] RBAC: Authorization granted {{(pid=86939) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:13:55.108170 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.notifications [None req-3391c8d7-ccf7-48aa-be89-f1841d637242 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8b4456c32a64e7e88e6efb5dc2e8a97'} {{(pid=86939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 12:13:55.108758 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.notifications [None req-3391c8d7-ccf7-48aa-be89-f1841d637242 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8b4456c32a64e7e88e6efb5dc2e8a97'} {{(pid=86939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 12:13:55.109372 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.notifications [None req-3391c8d7-ccf7-48aa-be89-f1841d637242 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8b4456c32a64e7e88e6efb5dc2e8a97'} {{(pid=86939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 12:13:55.118185 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.notifications [None req-3391c8d7-ccf7-48aa-be89-f1841d637242 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8b4456c32a64e7e88e6efb5dc2e8a97'} {{(pid=86939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 12:13:55.130801 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG keystone.notifications [None req-3391c8d7-ccf7-48aa-be89-f1841d637242 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8b4456c32a64e7e88e6efb5dc2e8a97'} {{(pid=86939) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 12:13:55.144072 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: [pid: 86939|app: 0|req: 633/1258] 10.222.0.44 () {58 vars in 1223 bytes} [Wed May 25 12:13:54 2022] DELETE /identity/v3/users/b8b4456c32a64e7e88e6efb5dc2e8a97 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 12:13:55.321365 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e72fd81-c4ad-457e-94c7-a0a4e7136aa7 admin admin] Authenticating user token {{(pid=86938) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 12:13:55.322908 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.fernet_utils [None req-3e72fd81-c4ad-457e-94c7-a0a4e7136aa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86938) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 12:13:55.335931 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e72fd81-c4ad-457e-94c7-a0a4e7136aa7 admin admin] Validating token access rules against request {{(pid=86938) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 12:13:55.393118 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c3aae-991d-4da3-abcc-b839770a78a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3f509c203864ee381a0b9ac7112de28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7103ef35356d4cd6a0f435bed6b1df47', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86938) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 12:13:55.393912 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c3aae-991d-4da3-abcc-b839770a78a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 12:13:55.394198 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c3aae-991d-4da3-abcc-b839770a78a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 12:13:55.394475 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c3aae-991d-4da3-abcc-b839770a78a1 admin admin] PATH_INFO: `/v3/projects/acc590f5e80e41469cebbdadac7dde76` {{(pid=86938) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 12:13:55.395648 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c3aae-991d-4da3-abcc-b839770a78a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acc590f5e80e41469cebbdadac7dde76)` {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 12:13:55.397636 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c3aae-991d-4da3-abcc-b839770a78a1 admin admin] RBAC: Authorization granted {{(pid=86938) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 12:13:55.442730 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.notifications [None req-b89c3aae-991d-4da3-abcc-b839770a78a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acc590f5e80e41469cebbdadac7dde76', 'request_id': 'req-b89c3aae-991d-4da3-abcc-b839770a78a1'} {{(pid=86938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 12:13:55.449372 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.notifications [None req-b89c3aae-991d-4da3-abcc-b839770a78a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acc590f5e80e41469cebbdadac7dde76', 'request_id': 'req-b89c3aae-991d-4da3-abcc-b839770a78a1'} {{(pid=86938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 12:13:55.454757 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.notifications [None req-b89c3aae-991d-4da3-abcc-b839770a78a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acc590f5e80e41469cebbdadac7dde76', 'request_id': 'req-b89c3aae-991d-4da3-abcc-b839770a78a1'} {{(pid=86938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 12:13:55.456373 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 12:13:55.469261 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.notifications [None req-b89c3aae-991d-4da3-abcc-b839770a78a1 admin admin] The token cache is being invalidate because project acc590f5e80e41469cebbdadac7dde76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86938) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 12:13:55.469852 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.notifications [None req-b89c3aae-991d-4da3-abcc-b839770a78a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 12:13:55.470154 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG keystone.notifications [None req-b89c3aae-991d-4da3-abcc-b839770a78a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86938) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 12:13:55.471680 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: [pid: 86938|app: 0|req: 626/1259] 10.222.0.44 () {58 vars in 1232 bytes} [Wed May 25 12:13:55 2022] DELETE /identity/v3/projects/acc590f5e80e41469cebbdadac7dde76 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 12:14:05.140705 dv-osbrick-830800-15-ceph devstack@keystone.service[86939]: DEBUG dbcounter [-] [86939] Writing DB stats keystone:SELECT=27,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 12:14:05.466304 dv-osbrick-830800-15-ceph devstack@keystone.service[86938]: DEBUG dbcounter [-] [86938] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=2 {{(pid=86938) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}